This feels like a fresh breath of air after all "I vibe coded this in 4 hours with Claude". Don't get me wrong, vibe coding had its own place, but it feels that projects like this one have become a rarity.
Thank you so much! That’s great to hear :)
I feel like vibe coding projects like this, where the whole idea is to learn, vibe coding only makes it harder
On the other hand, for future employers you might wanna simply showcase the creation. They don’t have all the knowledge to appreciate the technicals or even the time to sit through it.
Good point! Maybe indexing is a bad term here, and it's more like feature extraction (and since embeddings are high dimensional we extract a lot of features). From that point of view it makes sense that "the index" takes more space than the original data.
Why would the embeddings be higher dimensionally than the data? I imagine the embeddings would contain relatively higher entropy (and thus lower redundancy) than many types of source data.
The majority of them, yes, but it has always been so. What we actually care about is the tiny fraction of great works (by those novels, video games, movies), and in the future the best of the best will still be as good, because why would AI change that. If we stay where we are, that tiny percentage will be crafted by human geniuses (as it always has been), if something groundbreaking happens to AI, then maybe not.
Why wouldn’t AI change it? Everyone is expecting that it will, and it’s already starting to happen, just visit Amazon. The biggest reasons are that low-effort AI produced works by lazy authors & publishers may drown out the great works and make the tiny percentage far tinier and much harder to find, which may prevent many great works from ever being “discovered” and recognized as great. The new ability for many people without skill to use AI produce works that compete with skilled manual creation is a huge disincentive for creators to spend their lives studying and honing their skills. I’d bet there’s a hollowing out of the arts already occurring in universities globally. My interaction with college students over the last couple of years has very suddenly and dramatically turned into discussions about AI and concern about whether there will even be jobs for the subjects they’re studying.
Amazon has always been chock-full of ghostwritten amazon turked books, which were hot garbage easily on the level of chatgpt 3.5. The advent of AI won't change the cesspit of useless despair, because it's already so full you can't wade through all of it. Having more shit in a pit full of shit doesn't make it more shitty, especially if you had to wade through it to find a single pebble.
Sure it does. The ratio of good to bad absolutely matters. It determines the amount of effort required, and determines the statistical likelihood that something will be found and escape the pit. People are still writing actual books despite the ghostwritten garbage heap. If that ratio changes to be 10x or 100x or 1000x worse than it is today, it still looks like a majority garbage pile to the consumer, yes, but to creators it’s a meaningful 10, 100 or 1000x reduction in sales for the people who aren’t ghostwriting. AI will soon, if it doesn’t already, produce higher quality content than the “turked” stuff. And AI can produce ad-infinitum at even lower cost than mechanical turk. This could mean the difference between having any market for real writers, and it becoming infeasible.
What percentage of these great works have been downed out by the noise, never given serious attention, and been lost to time? Because that percentage is about to go way up.
Enough loud noise for long enough and I don't even hear it. Millennials never fell for the bs our parents and grandparents did online - we saw thru that shit as children and became the resident experts for all things tech bc of it.
I was the oldest millennial in my extended family that lived nearby, so I setup all my older family members internet - account, router & wifi, emails and FBs before I went to college. I'll bet some of those passwords are the same.
Gen Alpha should be able to be similar to that with us Millennials and AI - they will grow up with it, learn it, they will think about AI in prompts - not have to create prompts out of what they want (that's tough to explain) They will learn how to interact with AI as a friendly tool and won't have our hangups - specifically the ones regarding if they are awake or not, Gen Alpha will not care.
They will totally embrace AI without concern of privacy or the Terminator. Considering AI is about a toddler level the two will likely compete in many ways - the AI to show the ads and the kids to circumvent them as a basic example.
tldr: I think Gen Alpha ought to be able to just see AI content - there will be tells and those kids will kno them. So human content online especially the good stuff, but really all the many niches of it, should be all right in the future - even if good AI content is everywhere.
Wow, I rewrote this twice, sorry for the book - you mentioned something I've been thinking about recently and I obviously had way too much to say.
>They will totally embrace AI without concern of privacy or the Terminator.
Exactly, which is why SkyNet won't send the terminators after us for a few decades, when Gen Alpha has forgotten about the movies and decided to trust the machines.
The graph in that page is completely different (e.g. the sharp drop in 2015). This seems to be just linearly interpolating between start and end populations.
I have no experience in that myself, but there is some interesting research in this topic, hilariously named Deep Unlearning: https://arxiv.org/abs/2204.07655
I have done this, and I find my self activating caps-lock on other peoples computers all the time, it has become second nature in just a few weeks.
The only people who realistically need caps-lock are people writing software licenses and youtube video titles, everyone should be able to get by with the shift-key otherwise.
Is the whole escape key thing a joke that I'm not in on? Why don't you just use the part of the touchbar that is exactly the same as an escape key all the way down to saying "esc"? I don't get it man.
It's not the same. If you're used to typing without looking at your keyboard, a fake key on the touchbar does not compare to an actual key where you can feel without looking that your finger is in the right place, and can know by the key travel that you've actually pressed it.
It's pretty much the same as the difference between a car where the air conditioner and radio knobs are a touch screen vs. being real knobs that you can safely adjust while driving.
I thought that too, then I got one of the new MacBooks and used it for about a week. I stopped noticing that the escape key wasn’t a key somewhere between day 5 and 7. It’s very easy to hit, as you can trigger it by tapping anywhere on the edge of the touchbar (not just the graphical button), and thus I think it becomes very easy for your muscle memory to adjust.
I would still prefer a physical function row, but it’s not that big of a deal. And actually some of the controls on the touchbar are really nice, for example the volume and brightness controls for changing all your connected displays at once.
Exactly. You can just swipe the corner of it like you're brushing off dust or something, and it will register as a click. It's probably less effort than having to mash down a button that far to the edge of the keyboard.
While I'd normally agree, in this case, I have to disagree. Because the position of the button (proximity to the edge of the case and top-left corner of the keyboard), I have no trouble hitting it accurately without looking.
I'm an avid vim user, and the touchbar escape key gives me no trouble whatsoever. Since it's a single button on a far end with space between it and the other buttons, it's hard to miscalculate the position of the tap even without looking. There was no learning curve; it didn't take time to get used to it.
I suppose it's just a matter of personal preference and habit, though. Maybe some people have trouble aiming? I really thought I'd miss the tactile feedback (as has been the case with similar touch devices for me in the past), but in this case, I don't really notice it.
i'm a regular vim user and my muscle-memory still tells my finger to "press" the ESC button. without that tactile response something just feels a little off. i frequently find myself hitting it a second time while logged into remote terminals over poor connections, as i don't get the immediate visual cue that my ESC has registered. not only that but last week my touchbar became unresponsive (and after various attempts to fix it, is now completely blank), so now i don't even have an ESC button :( so now i've been using Ctrl[ until i get around to remapping ESC. i can't believe the touchbar doesn't drive apple engineers/devs crazy.. regretting replacing my 2014 mbp
It's like a car moving A/C controls to a touchscreen. Yeah, it's "the same"... but the lost of tactile feedback is a pretty dramatic thing. You really notice it when you use one.
* Distance to touch bar ESC is ~3-4 keys, which is quite a bit to travel for a pinky and for me even requires forearm movement. But this is the same, touch-bar or not, so I've been remapping since before the physical ESC disappeared anyway.
This is a bigger deal for me because I use vi mode on my terminal and so I hit ESC all the time in the terminal.
Also I use Dvorak, so 70% of my keystrokes are already on the home row, so moving off the home row for something so common as ESC is much more noticeable.
Lastly - who the hell uses caps lock anyway? For short words like ESC, holding shift has now become second nature. For longer things I often type it in lowercase, select in vim, then use `U` to convert to uppercase. For not-in-vim uppercase on the internet: I just don't shout. :P
reply