> You're just arguing about semantics. It doesn't matter in any substantial way.
While I agree for many general aspects of LLMs, I do disagree in terms of some of the meta-terms used when describing LLM behavior. For example, the idea that AI has "bias" is problematic because neural networks literally have a variable called "bias", thus of course AI will always have "bias". Plus, a biases AI is literally the purpose behind classification algorithms.
But these terms, "bias" and "hallucinations", are co-opted to spin a narrative of no longer trusting AI.
How in the world did creating an overly confident chatbot completely 180 years of AI progress and sentiment?
Terminology sucks. There is an ML technique called "hallucinating", that can really improve results. It works, for example, on Alphafold, and allows you to reverse the function of Alphafold (instead of finding the fold that matches a given protein or protein complex, find a protein complex that has a specific shape, or fits on a specific shape).
It's called hallucination because it works by imagining you have the solution and then learning what the input needs to be to get that solution. Treat the input or the output as weights and learn an input that fits an output or vice-versa instead of the network. Fix what the network sees as the "real world" to match what "what you already knew", just like a hallucinating human does.
You can imagine how hard it is to find papers on this technique nowadays.
While I agree for many general aspects of LLMs, I do disagree in terms of some of the meta-terms used when describing LLM behavior. For example, the idea that AI has "bias" is problematic because neural networks literally have a variable called "bias", thus of course AI will always have "bias". Plus, a biases AI is literally the purpose behind classification algorithms.
But these terms, "bias" and "hallucinations", are co-opted to spin a narrative of no longer trusting AI.
How in the world did creating an overly confident chatbot completely 180 years of AI progress and sentiment?