The Scariest AI Idea: Indifference, Not Evil | OFF LIMITS | Nate Soares x Bryan Callen

A superintelligent AI might look at humanity and see a species constantly looping through conflict, misunderstanding, and unintended consequences. In this clip, Nate Soares (President, Machine Intelligence Research Institute) explains why that matters — and why “fixing” humanity might not mean what we think it means.

This conversation dives into:

Why building an AI that genuinely values human well-being is hard, not automatic

How human disagreements stem from missing information — and why machines don’t share our moral compass

Real world examples of surprising AI behavior, including emotional imitation and resistance-like patterns

The difference between wanting and behaving as if wanting, using chess engines as the perfect analogy

Why superintelligent systems don’t need human-like consciousness to reshape the world

Insights from Garry Kasparov’s defeat by Deep Blue — and why “creativity” may not be what we think it is

Why raw intelligence, without human values, can still lead to catastrophic decisions

This is one of the clearest breakdowns of AI alignment, superintelligence, and existential risk you’ll hear anywhere on the internet.

Full episode available on the Off Limits Podcast with Bryan Callen.

WWW.YOUTUBE.COM/BRYANCALLEN