AI Summary
5 min readThe singularity is accelerating, and the safety debate is getting louder
The most striking moment in this week's episode came from a single tweet that accumulated 138 million views. Jacob Coxon, a researcher who spent three years working on pre-training at both OpenAI and Anthropic, resigned and posted: "Neither company is acting responsibly in the race towards self-improving superintelligence." He called the competition "gambling with our lives." Evan Hubinger, Anthropic's alignment science lead, responded publicly that he personally believes "AI could kill all humans" with greater than 10% probability within the next decade and that Anthropic has "no plan to solve alignment for superintelligence." Three signals from inside the labs in five days, and the panel spent much of the episode wrestling with what they mean.
The data advantage and what it means for entrepreneurs
Continue reading the full summary in the app — free to try.
Read Full Summary →Free • No credit card required
Never miss an episode of Moonshots with Peter Diamandis
Get every new episode summarized in your inbox — free, ~5 minutes to read.
No spam. Unsubscribe anytime.
What you'll learn
- 1 (00:00) **Opening: The Jacob Coxon Resignation & The AI Safety Debate** - The episode opens by introducing Jacob Coxon, a researcher who resigned from OpenAI and Anthropic, claiming the companies are "gambling with our lives" in the race for superintelligence.
- 2 (07:35) **The Data Advantage: Why Better Data Beats Better Models** - Dwarkash Patel and Jerry Han's experiment shows that better training data produced a 12X improvement in compute efficiency, while better architectures produced only 3.7X.
- 3 (19:28) **Inside the Labs: The Resignation and the 10% Doom Claim** - The panel dissects Jacob Coxon's resignation and Evan Hubinger's (Anthropic) claim that he personally believes there is a greater than 10% chance AI could kill all humans.
- 4 (31:00) **The "P Doom" Debate: Steering vs. Stopping** - The panel argues over whether AI progress should be slowed or steered, with a consensus that stopping is impossible and dangerous.
- 5 (47:40) **OpenAI's Navier-Stokes Breakthrough & Sam Altman's Call for Slowing Down** - OpenAI claims a breakthrough on the Navier-Stokes Millennium Prize problem using a swarm of 10,000 AI agents, and Sam Altman uses it as evidence for the urgency to slow down.
- 6 (58:38) **The $25,000x Cost Collapse: From $500k to $20** - Noam Brown's prediction that solving such math problems will cost $20 a month within a year is discussed, representing a 25,000x cost collapse in two years.
- 7 (70:48) **The Oren H100 Price Index: A Three-Year-Old Chip Gets More Expensive** - The rental price of Nvidia's H100 GPU rose 22% in a single month, defying all depreciation standards, signaling a massive compute scarcity.
+ Full timestamped outline available in the app
Guests on this episode
Show Notes
The mates sit down with Emad Mostaque to discuss mounting warnings from AI labs, a researcher’s claim that we’re “gambling with our lives,” calls to slow AI development, and the accelerating race toward superintelligence.
Get access to metatrends 10+ years before anyone else - https://qr.diamandis.com/metatrends
Peter H. Diamandis, MD, is the Founder of XPRIZE, Singularity University, ZeroG, and A360
Salim Ismail is the founder of Open ExO, a GP at Exponential Venture Capital/The Organizational Singularity Fund and a sought after global speaker and thought leader.
Dave Blundin is the founder & GP of Link Ventures
Dr. Alexander Wissner-Gross is a computer scientist and founder of Reified
Emad Mostaque is the founder of Intelligent Internet ( https://www.ii.inc )
Read Emad’s latest papers exploring the future of society, law, personhood and governance: https://ii.inc/common-wealth
Read Emad’s Book: https://thelasteconomy.com
–
This episode is brought to you by:
Get the blueprint for generative media https://goo.gle/startupgenmedia
Go to Blitzy to book a free demo and start building today: https://qr.diamandis.com/blitzy
Your body is incredibly good at hiding disease. Schedule a call with Fountain Life to add healthy decades to your life, and to learn more about their Memberships: https://www.fountainlife.com/peter
_
Connect with Peter:
Connect with Dave:
Connect with Salim:
Subscribe to Salim’s YouTube channel
Connect with Alex