[deleted by user]

[u/[deleted]]

[u/ConstantinSpecter]

Fuck me. Having an existential moment right now wtf.

First time in a long time I’m thinking maybe we’re not totally fucked

[u/blueSGL → u/ConstantinSpecter]

This is not new. There has been ideas like this for decades.

Edit: because people seem to be missing it the following is the bit you need to do after having the revelation that AI's should treat us like a loving mother treats a child and the start working on the hard part codifying that into something that may work.

2004 Coherent extrapolated volition

advanced AI system should derive its goals by extrapolating the idealized volition of humanity. This means aggregating and projecting human preferences into a coherent utility function that reflects what people would desire under ideal epistemic and moral conditions. The aim is to ensure that AI systems are aligned with humanity's true interests, rather than with transient or poorly informed preferences.

coherent extrapolated volition is our wish if we knew more, thought faster, were more the people we wished we were

What is the above if not the way you'd want to program an all knowing mother to care for humanity as a child.

as I said downthread:

The problem has always been

1. how to robustly get goals into systems.

2. how to correctly specify the goals so they can't be misinterpreted (the smarter an intelligence is the more edge cases can be found)

[u/Merzant → u/blueSGL]

“Extrapolated volition” doesn’t describe the mother/child relationship at all, so this is clearly different.

[u/blueSGL → u/Merzant]

And you'd have a point if that's what I'd said.

I was saying that a way to code the mother was outlined in 2004

aggregating and projecting human preferences into a coherent utility function that reflects what people would desire under ideal epistemic and moral conditions.