Emad is Robin Hood. Took VC wealth and redistributed it to the masses. Would love to see this more often. Do we really want Microsoft to monopolize AGI? At this rate average citizens won't even have computers capable of running a command prompt, all devices will be like iOS consumption only. "Sorry Dave, you're not allowed to open a terminal."
VCs don't have wealth, the people with money are called LPs or angels. I also don't know the particulars in this case, but they're usually pension funds rather than individual rich people.
(Which does mean VCs are stealing from pensioners by taking a lot of fees to invest in something worse than an index fund.)
Be careful getting too excited about an amphetamine addiction. Delusions of grandeur etc. Maybe your body doesn't want to do homework for good reasons? I see the legal speed industry as just another shameless means to get people to continue working at soulless jobs. Cruel to drug so many kids. Might as well not reproduce in the first place if you insist they must sit still. Not to mention the side effects on heart, brain, sleep and tendency to become almost as insufferable as cokeheads. Way too many parents giving it a pass because it's sold as "medication". How about we stop creating fucked societies instead?
> Attacking my style of prose doesn't change the facts.
True! I agree with everything you've said in this second post.
However:
1. What you're describing as "the facts" has changed pretty significantly between your first and second posts. As it turns out, being more careful about how you communicate seems to make you more careful about actually stating the facts instead of your opinions.
2. Even if your first post were all facts (which it was not), I would prefer that the facts be presented persuasively so that people believe the facts--making the facts sound like the crazed ramblings of a stoned person is counterproductive to spreading facts.
would a 192GB RAM mac studio or even a 7950x with 192GB RAM be practical for running this model for inference and possibly fine tuning? Especially if I don't need very low latency e.g. 1 token per second is fine for inference. i also have two 3090s.
You could run PyTorch on CPU and w/ a 12B activation pass, it might even run relatively fast (8 tok/s?), but a q4 quant would also easily fit on 2x3090s and should run at >60 tok/s.
The most obvious potential real reason is Stability isn't making money, and the people that matter don't think Emad was going to be able to turn it around.
There's nothing to enshitify, their models were open sourced. Now they may no longer release future models for free, but its entitlement to think we'll just get free improvements forever.
Also not all CEO replacements turn out bad. Uber certainly has turned itself around.
What I'm saying is that if it's really true that he is going out because "the people that matter don't think Emad was going to be able to turn it around" then it's very likely that the replacement will be more able to turn it around, because that will be the selection criteria.
I’ve made an example app for a Flutter plugin I created that can do this.
Open-source, runs natively on all major platforms. I shared videos showing it on my iPad Mini, Pixel 7, iPhone 12, Surface Pro (Win 10 & Ubuntu Jellyfish) and Macs (Intel & M archs).
By all means, it’s not a finished app. I simply wanted to use on-device AI stuff in Flutter so I started with porting over llama.cpp, and later on I’ll tinker with porting over whatever is the state of the art (whisper.cpp, bark.cpp etc).
App is compatible with any GGUF files, but it must be in the ChatML prompt format otherwise the chat UI/bubbles probably gets funky. I haven’t made it customizable yet, after all - it’s just an example app of the plugin. But I am actively working on it to nail my vision.
You can use it commercially but there are some restrictions, including some of a competitive nature, like using the output to train new LLMs. This is the restriction that Bytedance (Tiktok) was recently banned for violating.
so why then do you continue living in NYC if the quality of life is relatively worse? i bounced from a similar situation in sf to a lower cost of living area and am loving it, albeit i have the luxury of working remotely.
