AIs won’t run on a human sense of novelty.

A common objection we hear is: Suppose that an AI were just trying to make as many tiny titanium cubes as possible. Wouldn’t the AI get bored of that eventually?

And the short answer is: The AI isn’t a human. By default, it won’t experience “boredom”; it will have its own weird mix of motivations. And if it did experience boredom, it wouldn’t be bored by the same things as a human.

Caring about having fun is not an intrinsic property of all possible minds, and it’s vanishingly unlikely to be how AI works. Human values are a contingent fact of our biology and ancestry, and “fun” is no exception.

The AI’s actions aren’t incorrect answers to the question of how to have fun; the AI’s actions are simply driven by non-human mechanisms, by questions that make no reference to “fun.” See also the extended discussion on reflection.