I am continually surprised and depressed by how much blind trust is being placed in the accuracy and security of these LLM-mad-libs. I worry they'll do a lot of damage before attitudes catch up.
In some cases it might not be blind trust, but a command from above: "It's good enough when I tried it, and we need to demonstrate that We Are An AI Company to investors..."
My favourite is when companies replace their customer support with LLMs and then act like the LLMs are not their representatives and how they can't be held responsible for the shit they say.
In some cases it might not be blind trust, but a command from above: "It's good enough when I tried it, and we need to demonstrate that We Are An AI Company to investors..."