Anthropic co-founder on quitting OpenAI, AGI predictions, $100M talent wars, 20% unemployment, and the nightmare scenarios keeping him up at night | Ben Mann
July 20, 2025
AI Summary
5 min readBen Mann, co-founder and product engineering lead at Anthropic, discusses rapid AI progress, safety priorities that led him to leave OpenAI, and strategies for alignment amid scaling advances. Drawing from his GPT-3 work and Anthropic's focus on helpful, harmless, and honest AI, he addresses talent competition, job disruptions, and low-probability but high-stakes risks.
AI Scaling and Timelines
Scaling laws continue to hold across orders of magnitude, with progress accelerating via more frequent model releases—every few months rather than yearly—fueled by post-training techniques like reinforcement learning. Misconceptions of plateaus stem from time compression (rapid iterations feel incremental) and benchmark saturation on simple tasks; true advances show in complex benchmarks and efficiency gains. Bottlenecks include compute (data centers, power, chips), top talent, algorithms (e.g., transformers outperform LSTMs at scale), and data. Mann forecasts a 50th percentile chance of superintelligence around 2028, based on trends like effective compute doubling yearly and low-hanging fruit in training.
Continue reading the full summary in the app — free to try.
Read Full Summary →Free • No credit card required
What you'll learn
- 1 `* (04:51) **Talent Wars and $100M Offers**`
- 2 `* (07:48) **Scaling Laws Accelerating, Not Slowing**`
- 3 `* (10:51) **Defining AGI as Transformative AI via Economic Turing Test**`
- 4 `* (12:28) **AI-Driven Unemployment and Job Transformation**`
- 5 `* (17:46) **Career Advice and Skills for AI Future**`
- 6 `* (24:06) **Why Quit OpenAI to Found Anthropic**`
- 7 `* (27:39) **Alignment Mechanisms: Constitutional AI and HHH**`
+ Full timestamped outline available in the app
Show Notes
Benjamin Mann is a co-founder of Anthropic, an AI startup dedicated to building aligned, safety-first AI systems. Prior to Anthropic, Ben was one of the architects of GPT-3 at OpenAI. He left OpenAI driven by the mission to ensure that AI benefits humanity. In this episode, Ben opens up about the accelerating progress in AI and the urgent need to steer it responsibly.
In this conversation, we discuss:
1. The inside story of leaving OpenAI with the entire safety team to start Anthropic
2. How Meta’s $100M offers reveal the true market price of top AI talent
3. Why AI progress is still accelerating (not plateauing), and how most people misjudge the exponential
4. Ben’s “economic Turing test” for knowing when we’ve achieved AGI—and why it’s likely coming by 2027-2028
5. Why he believes 20% unemployment is inevitable
6. The AI nightmare scenarios that concern him most—and how he believes we can still avoid them
7. How focusing on AI safety created Claude’s beloved personality
8. What three skills he’s teaching his kids instead of traditional academics
—
Brought to you by:
Sauce—Turn customer pain into product revenue: https://sauce.app/lenny
LucidLink—Real-time cloud storage for teams: https://www.lucidlink.com/lenny
Fin—The #1 AI agent for customer service: https://fin.ai/lenny
—
Transcript: https://www.lennysnewsletter.com/p/anthropic-co-founder-benjamin-mann
—
My biggest takeaways (for paid newsletter subscribers): https://www.lennysnewsletter.com/i/168107911/my-biggest-takeaways-from-this-conversation
—
Where to find Ben Mann:
• LinkedIn: https://www.linkedin.com/in/benjamin-mann/
• Website: https://benjmann.net/
—
Where to find Lenny:
• Newsletter: https://www.lennysnewsletter.com
• X: https://twitter.com/lennysan
• LinkedIn: More from this podcast