Let's say, then, that it's not so much "dumb and wasteful" as "energy inefficient". In fact, this can be quite wise in a modern world full of surveillance-as-a-business and "us-east-1 disasters"
Can you elaborate the last statement? Don't quite understand why loading local LLM to GPU RAM, using it for the job and then "ejecting" is "dumb and wasteful" idea?
Because as a function of hardware and electricity costs, a “cloud” GPU will be many times more efficient per output token. You aren’t loading/offloading models and don’t have any parts of the GPU waiting for input. Everything is fully saturated always.
I believe GP means it still to be connected to 'if this kind of latency is unacceptable to you' - i.e. you can't load/use/unload, you have to keep it in RAM all the time.
In that case it's massively increasing your memory requirement not just to the peak the model needs, but to + whatever the other biggest use might be that'll be inherently concurrent with it.
Maybe it can not spy on you but models can be totally (e.g. politically) biased depending on the country of origin. Try to ask european-, us- or china-trained models about "Tiananmen Massacre" and compare the answers. Or consider Trump's recent decisions to get rid of "woke" AI models.
Classic problem: "Who do you love more: mum or dad?" ;) Surely it's naive thinking but as the EU citizen I feel like I've got a little more influence on "European censorship" than on any other. I suppose that ASML feels the same way
"The story, then, is everywhere. It is the founding myth of our system of economic relations. It is so deeply established in common sense, even in places like Madagascar, that most people on earth couldn’t imagine any other way that money possibly could have come about. The problem is there’s no evidence that it ever happened, and an enormous amount of evidence suggesting that it did not.”
Its wild to me how often people conflate "human nature" and culture. People who share a cultural background with Adam Smith may very well be accustomed to this self-interest-first way of seeing the world. People who would struggle to see other people's life ways as valid, because there's very little value in other people's perspectives. Especially if they involve practices that undermine profitability.
They're upset because the Russian government got caught publishing disinformation in the US, and DDG announced they were going to downrank puppet sites.
Presumably, they're also upset that search engines downrank penis enlargement ads, and machine generated stack overflow copy pastes.
