If you send the full 200k tokens on every request you will get very few requests before you hit the token limit. Caching reduces the number sent but I don't know how much they can cache?
My problem with CC is that it is trying to be very creative. I am asking it to fix some test, or create a new test. What it is doing? It is running grep to find all tests in the code base and parses them. This eats a lot of tokens.
Then it runs the test, as if I could not do this myself, it reads the output, sometimes very long (so more and more tokens are burned) and so on.
If people had to pay for this cleverness and creativity an API price, they would be a bit shocked and give up quickly CC.
Using Aider with Claude Sonnet I am eating much less tokens than CC does.
I remember the rise and the fall of AltaVista search engine.
I remember the rise of Google that was able to circumvent all the "old days" SEO efforts by spamming keywords in the HTML headers. Then everyone was trying to guess how to game Google page rank algo.
Finally people learned how to cheat Google, searches on many topics are returning endless pages of spam, marketing content that is supposed to earn AdSenens money (Google's "disruption" of online ads, better than all those cringe banners, that, eventually, destroyed Google search).
Right now Bing is working better for me (Bing! WTF?), for some stuff I use Yandex (shrug), but most of the stuff goes through AI, if you ask them to provide source of the information and you check it, this seems to be working fine...
For the time being, until people learn how to feed AI bots with the manipulated content they want. This will be probably more complicated, but it will happen (gaming page rank was also harder than adding "right" words to HTML keywords), unless AI providers will be careful with what they give as a food for their hungry Nvidia GPUs.
But this will be more expensive than blindly scanning the internet. That's why I see here a proper place where governments should step in, finance curation of the content for AI, as this will benefit society in a big way.
I see here an opportunity for smaller players, like Mistral, who can get some gov/EU funding and provide more quality than others who will devour whatever they find.
In the very first place... What's the freaking point to announce the divorce in the social media??? Why? Especially in the social media run by people known for having problems with moral behaviors (ask Winklevoss brothers), where 3/4 of their platform is either scam/fraud or infomercial.
2. You a have a public image that includes you being married and social media is one of the main channels over which you reach the people who know you. Now you get divorced and you do not want these people to have the false image of you being happily married and potentially even getting comments referencing your marriage anymore.
There are people who love divorces, love interacting with them, and love watching people go through them. It’s a cottage market in gossip futures. Social media is designed around gossip futures by people with questionable character. So you answered your own question ;) more shit piled onto the heap!
Could be a lot easier to rip off the band-aid all at once rather than pen a hand written note to dozens or more mutuals with subtle hints of "please stop sending couples invitations to social events"
http://litestep.net/ - worth to go and check this website. This is internet we used to have. Simple page, no crap, JS, etc., loads immediately and then stays in the cache.
Download link starts... download, instead of showing some "engagement" screens, asking for email, login with whatever account in the social media one has. If we wanted to discuss this software, well, there was a forum for this. No need to create account in Discord, Twitter, Facebook, and so on.
"I'm always surprised how they supposedly also manage to be some of the most cunning and evil actors when it comes to hacking"
This sentiment is probably overblown. The fact that they are effectively robbing people to earn some money for their pathetic regime means only that they are on the level of nowadays internet scammers. They are good at that too.
Spending enough money (and they spend a lot - 26 million people work only for this) one can train people to do this or hire people to do this for them.
This is good for the company, chances are you will eat more tokens. I liked Aider approach, it wasn't trying to be too clever, it used files added to chat and asks if it figure out that something more is needed (like, say, settings in case of Django application).
This article wasn’t written by ChatGPT — I wrote it myself. It’s meant to be just a brief explanation. I’m currently preparing a detailed piece about Workers & Pages, but it’s not that easy. The documentation isn’t very clear, so you end up figuring out many things empirically.
Oddly enough nowadays CERN is very much like a big corpo, yes they do science, but there is a huge overhead of corpo-like people who running CERN as an enterprise that should bring "income".
reply