Won’t we be able to exploit the AI’s critical weakness?

No.

To imagine that a superintelligence must have some critical flaw like “lack of creativity” or “inability to understand love” is Hollywood logic. While it might make for a satisfying twist in fiction, there isn’t an analogous phenomenon in real AIs.

See also “Won’t machines be fundamentally uncreative, or otherwise fatally flawed?” in the supplement to Chapter 1, and the Chapter 3 supplement’s discussion of anthropomorphism and mechanomorphism.

Your question not answered here?Submit a Question.