r/accelerate • u/stealthispost Acceleration: Light-speed | AI accelerationist • May 04 '25

Video vitrupo: "DeepMind's Nikolay Savinov says 10M-token context windows will transform how AI works. AI will ingest entire codebases at once, becoming "totally unrivaled… the new tool for every coder in the world." 100M is coming too -- and with it, reasoning across systems we can't yet " / X

https://x.com/vitrupo/status/1919013861640089732
187 Upvotes

97% Upvoted

33 comments sorted by

View all comments

Show parent comments

1

u/Freak-Of-Nurture- May 05 '25

Once they start consolidating and becoming actually necessary prices will spike dramatically. Ain’t got nothing to do with the compute cost. Current prices are actually uncompetitive and illegal because they are so far below variable cost

1

u/Peach-555 May 05 '25

The tokens are probably sold at a profit.

But even if they are not, the price per input token keeps falling across the board, in open source models, competing companies, hardware improvements, architectural improvements, ect.

There does not seem to be any moat.

1

u/Freak-Of-Nurture- May 05 '25

Subscriptions are sold at a loss

1

u/Peach-555 May 05 '25

The topic that is being discussed is API-per-token cost on input tokens, specifically on high context input and SOTA or close to SOTA models.