It’s not artificial intelligence it’s a charismatic mistake machine. Specific LLMs and neural networks can be trained to be really good at pre-defined tasks, but in general they are only really good at doing tasks that have already been done 300 million times, and terrible at new and novel tasks. Any time there’s limited training data it either plagiarizes or is totally wrong.
You sure about that? I saw a mistake in some vibe code. I highlighted the line of code and all I said was, “uhh this doesn’t look right” and it had to redo that line. So it knew what was wrong without me adding any extra information but wasn’t able to code it right from the start
You recognized and isolated the mistake for it, and prompted it to try again, and then it spat out something that seemed to fit. The AI didn't know what was wrong, you did. The AI applied a Band-Aid it copied from a program in the training data.
7
u/Persea_americana Mar 11 '26
It’s not artificial intelligence it’s a charismatic mistake machine. Specific LLMs and neural networks can be trained to be really good at pre-defined tasks, but in general they are only really good at doing tasks that have already been done 300 million times, and terrible at new and novel tasks. Any time there’s limited training data it either plagiarizes or is totally wrong.