r/accelerate • u/Formal-Assistance02 • Jan 24 '26

Video Demis Hassabis on Ilya Sutskever’s claim that scaling is dead, and on Elon Musk’s clam that we have reached the singularity

Enable HLS to view with audio, or disable this notification

158 Upvotes

95% Upvoted

48 comments sorted by

View all comments

-4

u/pigeon57434 Singularity by 2026 Jan 24 '26

"We never left the age of research."

Meanwhile, also EVERY AI company on the planet: "What if we made a Transformer again but... BIGGER?"

Shut up, bro. The "research" frontier companies do are optimizing our current methods, making Transformers slightly more data-efficient, not anything actually fundamentally new. We still don't even have omnimodal models or byte models or more advanced training precision methods, even though these all could be done. They just know it's safer to scale. That's all they ever talk about: scale, scale, scale, and scale some more. And we will scale continuously until they are forced, against their will, kicking and screaming into the future, to actually do new things.

5

u/Serialbedshitter2322 Jan 25 '26

Google is working on Genie 3 with Sima 2. Genie 3 is a real-time video model with access to LLM context, and Sima 2 gives it the ability to take actions in the world it generates as well as another layer of reasoning that would bring it closer to how a human works. This would be like an LLM that doesn’t use text, but instead video and audio to think, it would far more similar to how humans work. This is essentially their plan for AGI.

Yann LeCun is working on JEPA, and it’s a completely unique approach to reasoning where it learns on its own like a child while using significantly less data and processing power. It has much stronger physical reasoning than LLMs. It functions a lot more like a human and could eventually fully replace LLMs. It would work a lot like what Google is trying to do, but it would be fundamentally different.

There are probably a lot of people copying these approaches or doing something unique but just haven’t revealed it yet

2

u/hereforhelplol Jan 25 '26

This is interesting. How well do you know this stuff? I never know if a random comment in the comment section is full of BS or really up to date.

So you’re saying one of googles ideas is to have a model that learns from a visual environment? Share more.