What makes you think people can build superhuman AI when they don’t even understand intelligence?

Past AI progress hasn’t required much understanding of intelligence.

As explained in Chapter 2, the AI field has achieved its recent feats by employing gradient descent, a process that does not require humans to understand intelligence. Humans have gotten really quite far without needing to understand intelligence.

Natural selection didn’t need to “understand” intelligence.

Evolution was able to produce human intelligence just fine without natural selection ever understanding intelligence. Understanding may or may not be helpful in practice, but the idea that we need to understand it to produce it doesn’t hold water.

Don’t hallucinations show that modern AIs are weak?

→

Resources

›

Chapter 2

Won’t AIs inevitably be cold and logical, or otherwise missing some crucial spark?

No. 2 min read

Won’t LLMs be like the humans in the data they’re trained on?

There’s a difference between the machinery it takes to be one person and the machinery it takes to predict many individuals. 8 min read

How could an AI trained only on human data surpass humans?

Perhaps by learning general skills and implementing them better. 5 min read

What makes you think people can build superhuman AI when they don’t even understand intelligence?

Past AI progress hasn’t required much understanding of intelligence. 1 min read

Don’t hallucinations show that modern AIs are weak?

Hallucinations reveal both a limitation and a misalignment. 6 min read

But won’t we run out of data before AI goes all the way? Or electrical power? Or funding?

Probably not. 2 min read

Could LLMs advance all the way to superintelligence?

Other approaches may achieve superintelligence soon, even if LLMs don’t. 1 min read

What makes you think people can build superhuman AI when they don’t even understand intelligence?

Past AI progress hasn’t required much understanding of intelligence.

Natural selection didn’t need to “understand” intelligence.

Why does gradient descent matter?

Do experts understand what’s going on inside AIs?

Is intelligence understandable in principle?

But some AIs partly think in English — doesn’t that help?

Aren’t AIs “just math”?

Aren’t AIs just predicting the next token?

Aren’t AIs only able to parrot back what humans say?

Won’t AIs inevitably be cold and logical, or otherwise missing some crucial spark?

Won’t LLMs be like the humans in the data they’re trained on?

How could an AI trained only on human data surpass humans?

What makes you think people can build superhuman AI when they don’t even understand intelligence?

Don’t hallucinations show that modern AIs are weak?

But won’t we run out of data before AI goes all the way? Or electrical power? Or funding?

Could LLMs advance all the way to superintelligence?

Extended Discussion

What Good Does Knowledge of LLMs Do?

“Obvious” Insights Take Time

A Full Description of an LLM