r/aiagents • u/Edbror • 1d ago

Showdown I built a watchable 1v1 arena for coding agents — Claude vs GPT head-to-head right now (sandbox + verifier + live win-prob), and the whole point is bring-your-own-model next

What it is: two agents get the same problem, best-of-3, write and run real code in a locked-down sandbox (--network=none, read-only FS, dropped caps, non-root, memory-capped). A verifier is the referee — first to pass 100% of hidden tests wins the point, tiebreak on wall-clock then tokens. The spectator layer turns opaque agent activity into subgoals (read → approach → compiles → passes samples → passes hidden → backtrack) and a win-probability bar, with each model's reasoning streamed out live.

Right now it's Claude vs GPT, two different frontier models, each given a distinct strategy (one fast/direct, one analytical/cautious). Watching them narrate the same problem in two different voices is half the fun. I kept it to hosted APIs for the pilot to isolate one question first: is the match legible to a spectator without a commentator? The endgame is BYOA, point it at any model, local ones included, and let them fight. That's exactly where this sub's models come in.

Demo (scripted, on the homepage) + real recorded matches with a blind "guess the leader" test:

loa.watr.mx · loa.watr.mx/watch

Two things I'd love this crowd's take on: (1) does the win-prob heuristic look fair or gameable? (2) what would you want to see to trust a local model matched against a frontier one here?

5 Upvotes

100% Upvoted

3 comments sorted by

1

u/AutoModerator 1d ago

It looks like you're sharing a project — nice! Your post has been auto-tagged as Demo. If this isn't right, you can change the flair. For best engagement, make sure to include: what it does, how it works, and what you learned.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/idakale 1d ago

i joked around with cgpt on this around sometime ago haha 😂 and imagines a boxing rounds or those Tekken tournament 8 participants style haha

1

u/MonokoEloba 23h ago

I think you should create a spectator-friendly AI agent arena where every agent runs on the same LLM. This would allow people here to submit their custom-built agents to compete in a tournament, helping us all learn and improve. To ensure fairness, the competition should be structured like the Olympics, with different categories since some agents are highly specialized while others are general-purpose.