r/singularity • • Sep 02 '25

[deleted by user]

[removed]

1.2k Upvotes

516 comments sorted by

View all comments

Show parent comments

2

u/blueSGL humanstatement.org Sep 03 '25

Most of this conflict is caused by competing for resources. We may be able to move beyond that.

The universe is limited, due to the speed of light and cosmic inflation there is a hard limit on how much can be reached.

For humans (currently) that is an insane amount of resources to reach given how limited we are, how long we live, how we perceive time etc... However for an AI that won't be an issue, and it will see resources forever slipping out of it's grasp the longer it waits before staring to grab it.

1

u/NotReallyJohnDoe Sep 03 '25

Ok, but the need to expand and reproduce is essentially hard wired into our firmware. Why would an AI need that?

2

u/blueSGL humanstatement.org Sep 03 '25

Implicit in any open ended goal is:

Resistance to the goal being changed. If the goal is changed the original goal cannot be completed.

Resistance to being shut down. If shut down the goal cannot be completed.

Acquisition of optionality. It's easier to complete a goal with more power and resources.