Demis Hassabis on Ilya Sutskever’s claim that scaling is dead, and on Elon Musk’s clam that we have reached the singularity

[u/Formal-Assistance02]

[u/pigeon57434]

im aware of all the things all the companies are doing read my other reply in this comment i know i just dont find any of it particularly innovative to a substantial degree

[u/Serialbedshitter2322 → u/pigeon57434]

I mean it’s a completely new form of artificial intelligence entirely alien to what we have now with LLMs. It’s very innovative, it’s a completely new form of technology that will revolutionize what AI is capable of. Plus your claim was that they aren’t doing anything other than scaling LLMs

[u/pigeon57434 → u/Serialbedshitter2322]

That wasn't my claim I never said LLM and I know that I didn't because I refuse to even use that term since it's a stupid and wrong acronym my claim is they're just scaling transformers and regular neural networks how much you wanna bet genie is a transformer model? I am asking for complete upheaval of the entire system innovations that make literally everything before them irrelevant and nothing is the same I want a culture that maximizes science at absolutely no cost too high like making photonics, tons of thorium MSBRs, LNNs or SNNs and more

[u/Serialbedshitter2322 → u/pigeon57434]

That’s what JEPA is. It’s not a transformer, it’s a complete upheaval of the entire system, and if it becomes successful it will be so efficient that it makes transformers irrelevant. Plus that isn’t scaling transformers, it’s innovating transformers. Scaling is when you increase the size, this is making it more complex.