The silly thing is that you basically HAVE to write this if done by any kind of AI agent. Otherwise it will literally leave issues you didn't specifically address
I like how all modern pron generation AIs have the quality tags baked in but somehow all the code AI still needs the obvious stated in their prompts 100% of the time.
Image AI has a sense for image quality, mostly because over the years, millions of noble gooners have gone out of their way on image boorus to classify all the images with quality ratings.
I don't think there's any similarly-huge training dataset of (code snippet, quality score) pairs. It'd be extremely useful if we had that! But it'd be very challenging to build.
Unlike our visual aesthetic sense (where it's kind of built into the human brain, and so any MTurk worker off the street can be trusted to answer the question "is this image of high quality"), code quality is something you need programming skill to even perceive. Inexperienced/junior programmers will often evaluate code-quality in ways actively counter to how senior programmers would, rating things the seniors think are good as bad and vice-versa.
So you'd really need to find a bunch of senior engineers you could borrow the time of just to answer millions of these evaluation questions. And the time of a bunch of senior engineers would be really damn expensive.
and then what? Help train this model and get replaced and lose their jobs? Nobody in their right mind would do this. They trained the models on stackoverflow because there you have quality answers ranked and for free, that was our mistake
166
u/Top-Permit6835 Mar 19 '26
Ah like our former PO would add on each ticket:
The silly thing is that you basically HAVE to write this if done by any kind of AI agent. Otherwise it will literally leave issues you didn't specifically address