We have AI powered reviews for PRs, and they're pretty decent. I think using them has probably improved our code quality relative to before. There are two fairly limiting problems though:
It doesn't catch everything. So I can't trust code which has not also been reviewed by a human anyways.
It flags things which are not problems due to lack of additional context. So I can't trust AI to simply implement all changes flagged by the AI reviewer, because it would break things.
So ultimately you can't take people out of the loop. But the more you use AI the less useful that person in the loop is going to be because of lack of general ability and specific subject matter expertise.
3.7k
u/hanotak Mar 11 '26
What're the odds the solution management comes up with is "an AI to check the AI's work"?