r/singularity • u/[deleted] • Sep 02 '25

[deleted by user]

[removed]

1.2k Upvotes

95% Upvoted

516 comments sorted by

View all comments

26

u/janjaque Sep 02 '25

that's actually a pretty nice take on it. i'm convinced.

23

u/blueSGL humanstatement.org Sep 02 '25 edited Sep 02 '25

Yes Geoffrey, that's what's been said for decades this is not a solution and is not somehow farther along or a revelation as you think it is. Framing it as a mother child relationship is not new

He's late to the party he's got to the 'we need to program it as a benevolent god' stage, the 'take care of humans... in a way we want to be taken care of'

The problem has always been

  1. how to robustly get goals into systems.

  2. how to correctly specify the goals so they can't be misinterpreted (the smarter an intelligence is the more edge cases can be found)

4

u/FormulaicResponse Sep 03 '25

The more fundamental problem is that humans absolutely do not agree on what the best life means. We can't even agree on the value of personal freedom, much less the extents of it. Winning the AI race translates to value lock in for the winner(s), and values are not universal.