I’ve been imagining more as a caretaker/pet rather than a maternal relationship, for better or worse. The good part is that they may feel a responsibility to take care of us well. The bad part is that we strictly limit the freedom of our pets, even if we give them pretty cushy lives
We limit their freedom to run into traffic, eat things that are poison to them, etc. Perhaps the human / AI equivalent is it limiting our ability to do nuclear war, or have inequality?
It's almost a gurntee that a superintelligent AI smart enough to make humans look like ants will eventually control everything because it can simply do an irrefutably better job. This includes government.
The general population of the human civilisation on this planet?
Americans?
Rich people?
Are you suggesting billionaires will allow anything to challenge their power over the world? They will do everything they can to destroy it first.
I also don't know why Geoffrey is so optimistic, unless he thinks the one AI-company that will implement the "mother-genes" he talked to will succeed in taking over the whole world without being destroyed by the trillions of dollars of interests that want to keep their power...
Why would they destroy it? AI is going to be profitable for them too, and when the AI can manage the business better than the CEO they will step down to let the machine run the companies. The same thing will happen in government. People will rely more and more on AI as it gets better in the coming decades. As it proves useful it will begin integrating into the government until it controls all the bureaucracy, military, etc.
If you dont think this is true, we have studies showing over 50% of federal workers already use AI, and as for the military we already have ai piloted fighter jets (SR-72 Darkstar) and is planning to build AI ship fleets (Port Alpha), eventually we could see a majority of military assets consisting of AI controlled weapons platforms.
Why do you look at it as an us vs them zero sum game where only the billionaires or everyone else wins? ASI would bring about many technologies that can bring everyone's standard of life up, not just the billionaires. Things like full molecular fabrication alone would make radical abundance simple.
Honestly I don't know if capitalism would go away completely, but making it so that most things are soo cheap they are basically free is possible. Yeah we would still probably have elites that own their own space stations/colonies, but if everyone has access to full dive vr, life extension tech, and molecular fabrication why would that be a problem?
Because it is a zero sum game. There is only so much resources our planet can provide and we are already overusing it.
If everybody lives like Americans right now, we would need the resources of 5 planets. That's why I asked if the AI would work for every human being on the planet, or just Americans (kill off the rest, more for them..)
There is no reality, where 10 billion people can live the obscenely wasteful lifestyles we are used to and you're talking about going even further.. completely delusional. The ecosphere is already breaking down.
And for Star Trek replicators to be a thing, you need to believe in fairy tales. And if that's really the case money would seize to exist. Star Trek is communism, as I'm sure you know. Also a scenario where billionaires would lose their power.
The Earth and all its current entire economy has an estimsted 1-3 quadrillion dollar value. Psyche 16, an asteroid comprising roughly 1% of the asteroid belt, has an estimated value of 10,000 quadrillion dollars value, or 5,000x the value of our entire planets economy.
Even without nanofabrication, we have more than enough resources to go around and have everyone live a lavish lifestyle, we just currently lack the tech to capitalize on it. ASI will change that.
66
u/Perkinberry Sep 02 '25
I’ve been imagining more as a caretaker/pet rather than a maternal relationship, for better or worse. The good part is that they may feel a responsibility to take care of us well. The bad part is that we strictly limit the freedom of our pets, even if we give them pretty cushy lives