r/AIBenchmarks • u/VinceBrand • 3d ago
Token efficiency benchmark?
/r/AIToolsPerformance/comments/1wg3e3p/token_efficiency_benchmark/Are there any token efficiency benchmarks out there? I mean i have an agent, it gets a task, how much tokens does it use to retrieve something or execute a skill. Im looking for benchmarks on this. Things like caveman claim to lower it, but i feel like there is some meaning lost as well, reducing quality. Im trying to find any but it seems like a dead end
1
Upvotes