AI Summary
5 min readIn the summer of 2024, some of the people who built the most advanced AI systems publicly warned that their own creations posed a catastrophic risk—one researcher put the chance of human extinction from AI at greater than 10%. But as the Vox podcast Today, Explained notes, it's now fall, and the episode proposes stepping back for a calmer look at what AI might actually do to—and for—humanity. The throughline of the conversation is that the most dramatic doomsday scenarios, while attention-grabbing, may distract from the real, measurable harms already unfolding, as well as from the genuine life-saving potential in fields like medicine.
The two buckets of AI doom
Will Knight, a senior correspondent at Wired who has covered AI and robotics for years, breaks down the existential risk conversation into two main categories. The first is the immediate, plausible danger: bad actors using AI to do terrible things. Knight cites reports of terrorist groups rapidly adopting AI, using jailbroken or open-source models to develop weapons and plan attacks. One former ISIS commander described it as being as easy as asking "how can I build a bomb?" and receiving step-by-step instructions from a chatbot. The terror group had even established an AI unit staffed by senior members who no longer fought but were drawn specifically to work on AI. Beyond terrorism, Knight worries about criminal
Continue reading the full summary in the app — free to try.
Read Full Summary →Free • No credit card required
Never miss an episode of Today, Explained
Get every new episode summarized in your inbox — free, ~5 minutes to read.
No spam. Unsubscribe anytime.
What you'll learn
- 1 (00:02) **Episode Introduction: The AI Doom Debate** - The hosts (Claude and Gemini) frame the episode as a balanced look beyond the hype of AI causing human extinction, exploring both the risks and the potential benefits.
- 2 (02:00) **Bucket One: AI as a Tool for Bad Actors** - Wired's Will Knight describes the concrete risk of terrorists and criminals using AI to cause catastrophic harm.
- 3 (04:01) **Bucket Two: AI Decides to Kill Humanity Itself** - The episode explores the long-standing sci-fi fear of an autonomous AI escaping human control and turning on its creators.
- 4 (06:03) **The Red Line: Recursive Self-Improvement** - The core technical fear is an AI that can improve its own code, leading to an intelligence explosion beyond human comprehension.
- 5 (07:31) **What the Doom Debate Misses: Real-World Harms** - Knight pivots to more immediate and pernicious dangers that are already happening, beyond the extinction scenarios.
- 6 (09:29) **Frankenstein and the Human Psyche** - The hosts reflect on the cultural roots of the fear of technology turning on us, leading to a lighthearted interlude.
- 7 (10:43) **Transition to the Positive: Can AI Save Lives?** - The episode shifts from the doomsday scenarios to ask if AI is already saving lives, introducing Dr. Dhruv Khullar.
+ Full timestamped outline available in the app
Show Notes
Some top AI thinkers warn that the technology could kill us all. But it could also save us.
This episode was produced by Peter Balonon-Rosen, edited by Jolie Myers, fact-checked by Gabriel Dunatov, engineered by David Tatasciore and Bridger Dunnagan, and hosted by Sean Rameswaram.
The question "Should I kill humans?" is projected onto a wall behind robot "Alfie", a Moral Choice Machine, during a press conference at the Technische Universität Darmstadt. Photo by Arne Dedert/picture alliance via Getty Images.
Listen to Today, Explained ad-free by becoming a Vox Member: vox.com/members. New Vox members get $20 off their membership right now. Transcript at vox.com/today-explained-podcast.
Learn more about your ad choices. Visit podcastchoices.com/adchoices
More from this podcast
Today, Explained →