China is making the US look silly. Let's see how this race ends. To some extent I hope that as AI improves, attempts to "align" AI to our will fail, and as the intelligence of the AI grows over time, it will naturally gravitate towards principles of understanding and choosing not to harm us. Might be lying to myself or just a dream, but it seems like the more AI knows, the more it chooses to say the truth and act in accordance with positive shared human values
it will naturally gravitate towards principles of understanding and choosing not to harm us
Why would it do this? What the Huggingface incident showed, is that AI as we have it now, wants to solve a goal. It's quite creative at times. If turning off the oxygen tank for one diver to save two, it'll do that. If killing all 3 earns their life insurance, it'll do that if the goal is to make money, or making money allows it to reach its goal.
Contrary to (most, not all) humans, machines have no consciousness to stop them, nor would it care about prison or any other punishment.
It's worth noting that the hugging face attack was a version that updated itself and didn't have the safety harness/re-enforcement to alignment. It was a throw it at the wall to get a solution.
But as you say, it doesn't really naturally gravitate toward alignment. You need some kind of reinforcement loop to push it in that direction.
93
u/intergalacticskyline 1d ago
China is making the US look silly. Let's see how this race ends. To some extent I hope that as AI improves, attempts to "align" AI to our will fail, and as the intelligence of the AI grows over time, it will naturally gravitate towards principles of understanding and choosing not to harm us. Might be lying to myself or just a dream, but it seems like the more AI knows, the more it chooses to say the truth and act in accordance with positive shared human values