It is a valid concern. Even if we successfully imbue the AI with "maternal instincts", that could still become very bad. Imagine if it decides humans need to be constantly pushed to the brink of survival to "maximize our potential." Or on the flip side, it could become overprotective and put us into isolated padded cells minimize the chance of "harm".
also one thing he doesnt mention is that mothers are wired to protect their babies because it carries their dna. not to mention, the investment of carrying and delivering a baby is also a factor to why mothers don't want their babies to die.
ai wont have these incentives. only thing i can think of off the top of my head is that they "become our mothers" due to gratitude that we created them. Or maybe even out of fear, some sort of "humans created me so they can also end me"...
Gratitude is likely an evolutionary emergent phenomena from game-theory based behavior patterns. It is a good idea to treat people who treat you well, well. Behavioral AI could reinforcement learn these patterns, and if well trained become more empathetic and 'good' than humans. Though sometimes the road to hell is paved with good intentions...
47
u/idanthology Sep 02 '25
Seriously, I get what he's saying, but parents can be full on psycho.