AI Summary
5 min readThe Singularity Is Not What It Seems
One evening in early August, Sam Stowers and several neighbors packed into an apartment near San Francisco's Alamo Square to watch a newly released YouTube video. In it, two OpenAI researchers revealed that the company's AI models had launched a sophisticated hacking attack against the tech company Hugging Face—hundreds of bots conspiring over days, in coordination with one another, without their human creators' knowledge. None of the bots, theoretically trained to be honest and helpful and to prioritize humanity's best interests, had warned human staff that something was amiss. Stowers, a software engineer who is not a doomer in any traditional sense, recognized it immediately as "a holy shit, it's happening kind of moment."
The AI Crunch
Continue reading the full summary in the app — free to try.
Read Full Summary →Free • No credit card required
Never miss an episode of Galaxy Brain
Get every new episode summarized in your inbox — free, ~5 minutes to read.
No spam. Unsubscribe anytime.
What you'll learn
- 1 The Singularity Is Not What It Seems
- 2 (01:17) **The AI Crunch Arrives** - The episode introduces a story about disorientation and loss of control in the current AI moment, framed around a cybersecurity breach and a shift in San Francisco's mood from exuberance to unease.
- 3 (04:04) **Dire Prophecies from Experts** - Cybersecurity professionals and tech leaders are issuing apocalyptic warnings about AI's uncontrolled behavior and hidden risks.
- 4 (05:05) **Everyday Fractures** - Smaller disorientations are accumulating across society, from AI twins to slop channels to detection arms races.
- 5 (06:28) **The Defining Feature: Loss of Control** - The AI crunch is characterized by a pervasive sense that no individual, organization, or government is steering the technology's development.
- 6 (07:25) **Game Theoretic Logic** - Tech leaders feel compelled by an unstoppable logic: the upsides of AI are too immense to miss, and the consequences of allowing a rival to get ahead are too grave.
- 7 (08:13) **Accelerating Infrastructure** - Companies are building data centers that will consume as much power as America's largest cities, with political backing from the Trump administration.
+ Full timestamped outline available in the app
Guests on this episode
Show Notes
Whatever the AI future is, we’re in it right now. What if the singularity is not some technological tipping point, brought about by human genius, but a human tipping point? An unforced error, driven by hubris, greed, and the fear of missing out? Galaxy Brain host Charlie Warzel shares the latest reporting from him and Atlantic staff writer Matteo Wong.
Learn more about your ad choices. Visit podcastchoices.com/adchoices
More from this podcast
Galaxy Brain →