Humans evolved to be selfish, aggressive, and greedy. Won’t AI lack those evolved drives?

Those drives aren’t necessary to motivate resource acquisition.

Imagine an AI that’s piloting a robot to fetch some coffee. In order to fetch the coffee, it has to cross the street. Does the AI drive the robot recklessly into the street, where it gets smashed by a truck? No.

Why not? Because the robot can’t fetch the coffee if it’s destroyed.

The AI doesn’t need to have a human-style survival instinct in order to do its best to avoid death. Survival instincts in humans are one way of doing the work of avoiding dying while we’re trying to achieve other goals. AIs probably won’t do that work in exactly the same way, but they’ll still have to do the same work, because you can’t fetch coffee when you’re dead.*

Matter and energy are useful for almost every goal. No matter what the AI is steering toward, it can probably get it more effectively with more matter and more energy. The AI doesn’t need to be selfish, aggressive, or greedy in the manner of a human in order to do the work of securing resources to achieve its goals.

And the danger arises from the work, not from the reason the work is done.

An AI that doesn’t hate you can still take actions that are lethally dangerous to you, just as a chess AI can crush you at chess without feeling competitive or driven to win.

 See also the question of whether the AI can be satisfied and then leave us alone.

Your question not answered here?Submit a Question.