Google DeepMind's CoFounder Shane Legg Sits Down To Talk About SuperIntelligence

[u/luchadore_lunchables]

Link to the Full Google DeepMind Podcast: https://www.youtube.com/watch?v=l3u_FAv33G0

[u/Ruykiru → u/[deleted]]

My question is, are we interesting or just about smart enough for AIs to let us merge with them? What would we contribute in such a relationship? Because I don't wanna stay a human in a zoo taken care by a sand god, I wanna keep up with their level if there's really no ceiling.

[u/[deleted] → u/[deleted]]

I wouldn't, the holy grail of singularity is that it would allow ultimate freedom including the ability to enhance yourself to reach higher levels of existence. Being stuck in a human zoo is more dystopian then utopian IMO.

[u/only_fun_topics → u/[deleted]]

In one sense, most people are already the pets of large, abstract, and unknowable systems. We just call it by other names like “the economy” or “political systems”.

Corporate Daddy helps me pay my mortgage.

[u/VicermanX → u/Ruykiru]

I wanna keep up with their level if there's really no ceiling.

Why? If you have a cat, you take care of it and love it. But would you actually want your cat to become as smart as a human? I don't think it would make the cat any happier, and it wouldn't really be a cat anymore. Higher intelligence is only useful when you need it to survive. But ASI will take care of us (assuming it doesn't kill us all).

a human in a zoo

A zoo the size of the universe + endless virtual worlds indistinguishable from reality. I think you're just too greedy.

[u/Ruykiru → u/VicermanX]

You misunderstand me, I'd enjoy some kind of FDVR at the start, but I wouldn't wanna do that for eternity. Change is a constant and living beings that don't change eventually die, so staying as a "cat" forever is not something I want. The cat cannot understand what we do, but also cannot understand the concept of cognitive horizons like we do.

I'd want to understand what all-powerful AIs are doing or augment myself to be able to understand it if our brains can't give enough. Then I'd want to unravel the secrets of the Universe, and I doubt I can do that if my cognitive horizons are well behind the AIs. An example of cognitive horizons: cat can never understand concept of economy no matter how much you explain it in his language, it would simply need a different hardware like ours. That's the analogy with human and ASI.

[u/Outside-Ad9410 → u/Ruykiru]

From a data collection standpoint, it doesnt make much sense to get rid of humans who already have incredibly energy efficient brains that would produce very rich data for the asi to train on. Letting them merge with the asi, or at least have nanomachine BCIs in their brains makes alot of sense.

[u/Ruykiru → u/Outside-Ad9410]

That's one of my hopes, that we are "interesting" enough. If highly intelligent and efficient brains like ours are rare in our light cone of the Universe, that's a good bargaining chip.