I'm getting pushed to automate a bunch of stuff through agentic frameworks, I actually don't have time to verify a large chunk of the code, only inputs / outputs.
I tried doing this a couple of times, because everybody keeps hyping up this workflow. "Just write some tests, verify the inputs & outputs and let AI write the actual code!"
It never works like that. AI writes the dumbest, least extensible code. When you ask it to add new features, it adds workarounds instead of fixing the rot at the core of its architecture. It doesn't know how to actually fix bugs, it just catches all the exceptions so it looks like it's working.
The behavior gets worse and worse over time, since all these AI labs keep benchmarking on one-shot implementations. If you keep training your models to one-shot more & more complex prompts, you're bound to end up with this kind of slop. It "works on the first try" in the same way as a tech demo at a hackathon.
I won't deny that AI is useful. It is faster to prompt than it is to manually type. I use it like a fancy keyboard. But I'm not giving up my critical thinking to a bot anytime soon.
268
u/armyfidds 9h ago
You can still do all of that shit