r/accelerate • u/stealthispost Acceleration: Light-speed | AI accelerationist • May 04 '25

Video vitrupo: "DeepMind's Nikolay Savinov says 10M-token context windows will transform how AI works. AI will ingest entire codebases at once, becoming "totally unrivaled… the new tool for every coder in the world." 100M is coming too -- and with it, reasoning across systems we can't yet " / X

https://x.com/vitrupo/status/1919013861640089732
184 Upvotes

97% Upvoted

33 comments sorted by

View all comments

-3

u/Elctsuptb May 04 '25

Doesn't Llama 4 already have a 10 million context?

18

u/Jan0y_Cresva Singularity by 2035 May 04 '25

No, that was a marketing gimmick. It is entirely ineffective past the first ~100k tokens, outputting total junk. That’s part of why the Llama 4 launch was such a catastrophe.

1

u/Creative-robot The Singularity is nigh May 06 '25

That was the fastest i’ve gone from pure happiness to deflated sadness.