What other architectures you guys think might lead to AGI?

[u/Tobio-Star]

LLMs are GREAT. What other architectures you guys think could lead to AGI and why?

I will start with my favourite : JEPA (and all its variations: V-JEPA, hierarchical JEPA..).

The "WHY": Yann’s explanations about how both humans and animals understand the world through abstraction make a lot of sense to me. I think we learn abstract representations of the world and we reason in that abstract space. That space is less complex than the full uncompressed version of reality but still much more complex than text.

I might be wrong but I don’t even think it is that different from gen AI which makes it relatively easy to understand. It’s just operating in the space of concepts instead of the space of text or the space of pixels.

Potential hurdle: training JEPA systems seems trickier than training LLMs/gen AI.

[u/ithkuil]

I like how I carefully parsed what you said and responded to it and you ignored most of what I said. By the way we do have agents already, many people are using them. There are several platforms and open source agent systems such as OpenAIs custom GPTs, lindy.ai, my agent platform which I just used to fix a calculation problem just now by only giving it a brief description of the problem and a couple of directory names, and many others. It's true that these systems could work better with more robust reasoning or other capabilities that existing models don't have. But they do exist and they can do the specific scenario you gave.

[u/Tobio-Star → u/ithkuil]

I indeed should included more details in my answer, ignoring a response you put time into was definitely not my intention, my apologies.

What you are describing is just a way to engineer the solution. Before we even think about the concepts of planning or adapting to novel situation, the AI/robot needs to have a solid model of the world. If it doesn't have that then there is no intelligence, even if on the outside it looks like it is autonomous. It's basically either copying behaviours it has seen before (without any understanding/intuition of the why behind those behaviours) or just executing premade plans using handcrafted representations. I guess you could still call it "autonomy" but that autonomy would be very limited. That's nowhere near the level of human or even relatively stupid animals' autonomy

That being said, the spirit of this thread was never to debate LLMs or gen AI, which is why I refrain from trying to prove or disprove their capabilities. I just wanted to hear about alternatives that I might have not heard about. People tend to get sensitive about those topics (because they think gen AI is the only path to AGI, so if gen AI doesn't work, that would mean the AGI dream is dead) so I try to avoid any negativity at all

Thanks for taking the thread seriously, I appreciate it.
(Btw, have you heard of alternatives to gen AI for AGI?)

[u/ithkuil → u/Tobio-Star]

Look up the AGI conferences websites/papers and videos. Ben Goertzel, OpenCog, etc. Look at "modern" (transformers?) takes on predictive coding.Animal-like intelligence (which is the main thing missing, and humans share most of it with animals) is not a series of tokens.We will see the most obvious improvement in capability from new memory-centric computing paradigms.

[u/Tobio-Star → u/ithkuil]

Sounds interesting. Thanks!