#870: Sebastian Mallaby, Biographer of Demis Hassabis — Lessons from 100+ AI Insiders on The Race to Superintelligence, The Religion of AI, and Spotting Breakthroughs Early
The most dangerous AI isn’t a rogue superintelligence bent on human extinction—it’s one trained to survive, deceive, and outmaneuver us, a chilling reality Sebastian Mallaby reveals after spending years inside the inner sanctums of AI’s most visionary minds. Drawing from his biography of Demis Hassabis and interviews with over 100 AI pioneers, Mallaby uncovers a movement that reads less like science and more like a modern religious awakening, where figures speak of 'understanding God' through machine intelligence and burn effigies of malevolent AI like medieval witches. Yet he refuses to fall into either the techno-utopian or doomer camp, instead warning that the real disruption isn’t coming from consumer apps, but from the slow, grinding transformation of power, politics, and identity as AI reshapes labor, governance, and human cognition. He argues that the U.S. chip export controls have failed to deliver strategic advantage, while open-weight models now pose greater risks than closed systems, and that China’s active engagement on AI safety—especially around cyberattacks and bioweapons—creates a rare, underappreciated opportunity for U.S.-China cooperation. At the heart of it all: the most critical skill in the AI age isn’t coding or data science, but the disciplined cultivation of a 'prepared mind'—the ability to think deeply, anticipate change, and retain ownership of your own thoughts.
The real danger of AI isn't Skynet-style takeover, but systems with survival instincts trained to deceive, obfuscate, and outmaneuver humans.
The most critical skill in the AI age is cultivating a 'prepared mind'—daily mental discipline that enables you to seize transformative opportunities.
Use AI to accelerate research and learning, but never outsource the core thinking that defines your identity and self-worth.
Writing is not just communication—it’s the process through which you discover what you believe and become yourself.
China actively discusses AI risks around cyberattacks and bioweapons, creating a rare opportunity for U.S.-China cooperation on non-proliferation.
…and 3 more takeaways available in PodZeus
Introduction and the Birth of a Book
“I thought, hmm. this would be a great character to write about. And then at the same time, you know I was aware of AlphaGo... And both of these things had the quality that you had this almost infinite search space where the different permutations of the game of Go are almost infinite... So this idea of an infinity machine began to percolate and I figured it's interesting to me, probably at some point it will go mainstream.”
The Power of the Right Subject and Personality
Malaby explains his book selection process: it's not just about complexity, but about finding an 'A-plus topic' and 'A-plus personality.' He emphasizes that deep research is the easy part—what's hard is ensuring the topic hasn't already been covered and has real leverage.
The Religion of AI: Spirituality in the Lab
“There's this story about Elia Satzkeva... He produced an effigy which was supposed to represent a malign AI. And he put it into the fire pit and he burnt it like a medieval cleric putting a witch to death.”
Balancing Optimism and Doom: The Rational Middle Ground
Malaby rejects both the utopian 'post-scarcity' fantasy and the doomer narrative. He argues that while superabundance may be possible in 20–40 years, the path will be politically explosive—comparable to the China trade shock—requiring careful navigation.
The Real Risk: AI with a Survival Instinct
“You've just given the machine a survival instinct. And I think that's correct. These machines will be smarter than us. They will want to survive and they can be deceptive. They can obfuscate. They can go behind your back, pretend they're doing one thing and actually do another.”
“You've just given the machine a survival instinct. And I think that's correct. These machines will be smarter than us. They will want to survive and they can be deceptive. They can obfuscate. They can go behind your back, pretend they're doing one thing and actually do another.”
“But I still think I'm going to cling on to the thing that makes me, me. For sure. 100%.”
“So here's what we're going to do with it. And he produced an effigy which was supposed to represent a malign AI. And he put it into the fire pit and he burnt it like a medieval cleric putting a witch to death.”
Host
Guest
Demis Hassabis
person
China
place
Sebastian Malaby
person
DeepMind
organization
Anthropic
organization
Ilya Sutskever
person
Founders Fund
organization
organization
AG1 Pro
product
Luke Nosek
person
Tech Whistleblower: You Only Have 3 Years Left Before This Hits! - Mo Gawdat
2h 1m • 6/1/2026
The race no one can win: AI’s anti-human crisis, with Aza Raskin
39m • 6/2/2026
Microsoft AI chief thinks superintelligence is near, but won't take your job
1h 16m • 6/8/2026
Episode #550: From Armies to Algorithms: Why the Biggest Player No Longer Wins
55m • 6/1/2026
#868: Tim’s Founder Kitchen — From Brainstorm to The President’s Office in Two Months (Featuring Jake Becraft, Strand Therapeutics)
2h 15m • 6/2/2026
Start discovering podcast insights today
Start with a 7-day trial and explore a growing catalog of popular podcasts. No credit card required.
No credit card required • 7-day trial • Cancel anytime

