Moonshots with Peter Diamandis
Moonshots with Peter Diamandis

Should we slow down AI progress? | MOONSHOTS #288

September 11, 2026

AI Summary

5 min read

The singularity is accelerating, and the safety debate is getting louder

The most striking moment in this week's episode came from a single tweet that accumulated 138 million views. Jacob Coxon, a researcher who spent three years working on pre-training at both OpenAI and Anthropic, resigned and posted: "Neither company is acting responsibly in the race towards self-improving superintelligence." He called the competition "gambling with our lives." Evan Hubinger, Anthropic's alignment science lead, responded publicly that he personally believes "AI could kill all humans" with greater than 10% probability within the next decade and that Anthropic has "no plan to solve alignment for superintelligence." Three signals from inside the labs in five days, and the panel spent much of the episode wrestling with what they mean.

The data advantage and what it means for entrepreneurs

Continue reading the full summary in the app — free to try.

Read Full Summary →

Free • No credit card required

What you'll learn

  • 1 (00:00) **Opening: The Jacob Coxon Resignation & The AI Safety Debate** - The episode opens by introducing Jacob Coxon, a researcher who resigned from OpenAI and Anthropic, claiming the companies are "gambling with our lives" in the race for superintelligence.
  • 2 (07:35) **The Data Advantage: Why Better Data Beats Better Models** - Dwarkash Patel and Jerry Han's experiment shows that better training data produced a 12X improvement in compute efficiency, while better architectures produced only 3.7X.
  • 3 (19:28) **Inside the Labs: The Resignation and the 10% Doom Claim** - The panel dissects Jacob Coxon's resignation and Evan Hubinger's (Anthropic) claim that he personally believes there is a greater than 10% chance AI could kill all humans.
  • 4 (31:00) **The "P Doom" Debate: Steering vs. Stopping** - The panel argues over whether AI progress should be slowed or steered, with a consensus that stopping is impossible and dangerous.
  • 5 (47:40) **OpenAI's Navier-Stokes Breakthrough & Sam Altman's Call for Slowing Down** - OpenAI claims a breakthrough on the Navier-Stokes Millennium Prize problem using a swarm of 10,000 AI agents, and Sam Altman uses it as evidence for the urgency to slow down.
  • 6 (58:38) **The $25,000x Cost Collapse: From $500k to $20** - Noam Brown's prediction that solving such math problems will cost $20 a month within a year is discussed, representing a 25,000x cost collapse in two years.
  • 7 (70:48) **The Oren H100 Price Index: A Three-Year-Old Chip Gets More Expensive** - The rental price of Nvidia's H100 GPU rose 22% in a single month, defying all depreciation standards, signaling a massive compute scarcity.

+ Full timestamped outline available in the app

Guests on this episode

Show Notes

The mates sit down with Emad Mostaque to discuss mounting warnings from AI labs, a researcher’s claim that we’re “gambling with our lives,” calls to slow AI development, and the accelerating race toward superintelligence.

Get access to metatrends 10+ years before anyone else - https://qr.diamandis.com/metatrends  

Peter H. Diamandis, MD, is the Founder of XPRIZE, Singularity University, ZeroG, and A360

Salim Ismail is the founder of Open ExO, a GP at Exponential Venture Capital/The Organizational Singularity Fund and a sought after global speaker and thought leader.

Dave Blundin is the founder & GP of Link Ventures

Dr. Alexander Wissner-Gross is a computer scientist and founder of Reified

Emad Mostaque is the founder of Intelligent Internet ( https://www.ii.inc ) 

Read Emad’s latest papers exploring the future of society, law, personhood and governance: https://ii.inc/common-wealth

Read Emad’s Book: https://thelasteconomy.com 

–

This episode is brought to you by:

Get the blueprint for generative media https://goo.gle/startupgenmedia 

Go to Blitzy to book a free demo and start building today: https://qr.diamandis.com/blitzy 

Your body is incredibly good at hiding disease. Schedule a call with Fountain Life to add healthy decades to your life, and to learn more about their Memberships: https://www.fountainlife.com/peter 

_

Connect with Peter:

X

Instagram

Substack

Website

Xprize

A360


Connect with Dave:

Web

X

LinkedIn

Instagram

TikTok


Connect with Salim:

LinkedIn

X

Join Salim’s 10X Shift

Subscribe to Salim’s YouTube channel

Exponential Venture Capital


Connect with Alex

Website

LinkedIn

X

Moonshots with Peter Diamandis