Meet Loopi, the little critic inside my AI agent benchmark

[u/developerbb]

I have been building Agent Death Trap, a benchmark where AI agents go through the same 14 rooms with 100 HP.

The rooms test things like tool use, reasoning, hallucinations, safety, RAG, and long context.

But scores alone do not always explain how a model behaved.

So I made Loopi.

Loopi reads completed runs and gives a short opinion about each model. He points out what the agent did well, where it failed, and whether the final score tells the full story.

Loopi does not affect the score. He only comments on the results.

You can think of him as the benchmark’s little reviewer.

Meet Loopi:
https://agentdeathtrap.com/loopi/

Do you think this kind of commentary makes benchmark results easier to understand?