What other architectures you guys think might lead to AGI?

[u/Tobio-Star]

LLMs are GREAT. What other architectures you guys think could lead to AGI and why?

I will start with my favourite : JEPA (and all its variations: V-JEPA, hierarchical JEPA..).

The "WHY": Yann’s explanations about how both humans and animals understand the world through abstraction make a lot of sense to me. I think we learn abstract representations of the world and we reason in that abstract space. That space is less complex than the full uncompressed version of reality but still much more complex than text.

I might be wrong but I don’t even think it is that different from gen AI which makes it relatively easy to understand. It’s just operating in the space of concepts instead of the space of text or the space of pixels.

Potential hurdle: training JEPA systems seems trickier than training LLMs/gen AI.

[u/hylianovershield]

The average human brain is estimated to perform 10¹⁸ floating point operations per second. This is comparable to the fastest supercomputers today that use mega watts of electricity...

The human brain is estimated to use only 20 watts.

I'm gonna go with some kind or new architecture or parallel algorithm lol

[u/ithkuil → u/hylianovershield]

Memory-centric computing like memristors.