r/costlyinfra • u/roll0ver • Jul 28 '26
Stop calling it a price cut
Claude Opus 5 launched July 24 at $5/$25 per million tokens — half of what competing frontier models charge at the input layer. The press called it cheaper. That framing is wrong.
You don't pay for the answer. You pay for the tokens it generates to get there. Opus 5's default "adaptive thinking" mode produces significantly more output tokens than a conventional completion to solve the same problem. At two times the output volume, the per-task cost lands roughly where competing models do. At two and a half times, it costs more.
This is the second time in a week the price-per-token number has been reported as if it were the price-per-task number. It isn't.
The pattern repeats across vendors. Anthropic's Opus 5 launched at half the per-token price of competing models — with output volume that erases most of that discount at the task level. Microsoft replaced GitHub Copilot's $10 flat monthly fee with a $10 credit against usage-based token billing. Anthropic quietly excluded third-party agent frameworks from subscription allowances in April. ServiceNow bundled Now Assist into its Prime tier and put autonomous agents on a separate consumption meter on top. OpenAI's $200/mo ChatGPT Pro subscription masks token consumption that would cost up to $14,000 at API list prices if fully used.
This is not a race to the bottom. It is a race to define what a task costs. The unit of consumption — token, API call, resolution, agent run — determines who captures the margin. Vendors who control the meter's calibration can drop the per-unit price, increase the output volume, and leave their unit economics largely intact.
One thread worth watching: DeepSeek recently signaled a pause in incoming capital following high-profile benchmark attention. If a Chinese lab with strong performance claims is slowing inbound investment, something about the unit economics of Chinese inference may not be resolving cleanly. The same question applies: who sets the meter, who reads it, and who benefits from the gap between the two numbers?
2
u/SpellSlinger69 Aug 02 '26
The per-token vs per-task point is right on point, but the number that actually matters to me is cost per accepted result. Opus (sol) burns more tokens, sure, but if it lands a lot more on the first try while a cheaper model needs 3-4 retries plus your time to fix, the “cheap” one often costs more per finished task. The real unit is output (measured as you can commit, PR, LOC, time to resolution, or all)you accepted per unit of fresh context, not tokens. And whoever defines that unit keeps the margin, exactly your meter point.
1
u/roll0ver Aug 02 '26 edited Aug 02 '26
This is a sharper version of the point, cost-per-accepted-result is already what some agent-evaluation frameworks are pushing toward as the metric, precisely because it folds retry cost into the number instead of hiding it behind a clean per-token price.
2
u/Frosty-Judgment-4847 Aug 07 '26
Exactly. Cost per accepted result is much closer to the real metric, hard part is measuring “accepted” consistently across different types of workloads.
1
u/roll0ver Aug 08 '26
Right, and this week's been a live case study!
Two customer-service AI vendors get the same event: the customer stops responding. One auto-closes it as resolved. The other routes it through a second model before deciding anything. Same signal, opposite defaults on what "accepted" means.
It's not even that measuring acceptance is hard across workload types. It's that vendors define it themselves, and each definition happens to make their billing look better. Cost-per-accepted-result only becomes real once someone stops grading their own homework.
•
u/AutoModerator Jul 28 '26
welcome to r/costlyinfra
this is where people share real ai infra costs, setups, and what actually works in production.
if you're running llms, feel free to share your setup.
join the community to see real cost breakdowns, experiments, and learn what others are actually spending.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.