METR’s Joel Becker on exponential Time Horizon Evals, Threat Models, and the Limits of AI Productivity

February 27, 2026

AI Summary

5 min read

🎙️ The Voices & The Context

The Format: Casual interview-style podcast chat with hosts probing a guest expert on AI research.
The Key Players:
- Guest: Joe Becker from Meter (M-E-T-R), an independent AI org focused on model evaluation and threat research; known for impactful papers like the time horizon chart and developer productivity RCTs; former superforecaster vibe, now top Manifold trader via clever hacks.
- Hosts: Alessio (Kernel Labs founder) and Swix (Laden Space editor); sharp, tech-savvy banter on AI trends, benchmarks, and labs.
The Vibe: Educational yet fun—deep dives into AI risks and evals mixed with soccer shoutouts, karaoke plugs, and cheeky prediction market tales; optimistic on continuity but cautious on explosions.

🗝️ Key Themes & Topics

The episode unpacks Meter's role in AI safety via rigorous evals, blending capabilities benchmarks, real-world productivity tests, and threat modeling amid hype.

Continue reading the full summary in the app — free to try.

Read Full Summary →

Free • No credit card required

Listen to Audio Summary Open in App

What you'll learn

1 (00:00) **🎙️ Introduction: Joe Becker**
2 (01:39) **METR's Threat Models and Focus Areas**
3 (03:33) **Model Time Horizon Chart**
4 (07:33) **Benchmarks and Task Examples (SWE-bench, HCAsT, RE-bench)**
5 (11:37) **o1 (Opus 4.5) Performance Jump**
6 (14:29) **Developer Productivity RCT Study**
7 (20:55) **Why Current Models Aren't Catastrophically Dangerous**

+ Full timestamped outline available in the app

Show Notes

This is a free preview of a paid episode. To hear more, visit www.latent.space

AIE Europe CFP and AIE World’s Fair paper submissions for CAIS peer review are due TODAY - do not delay! Last call ever.

We’re excited to welcome METR for their first LS Pod, hopefully the first of many:

METR are keepers of currently the single most infamous chart in AI:

But every Latent Space reader should be sophisticated enough to know that the details matter and that hype and hyperbole go hand in hand in AI social media, because the millions of impressions that got, by people who don’t understand or care about the nuances, disclaimers, and error bars, far outreaches the 69k views on the corrections by the people who actually made the chart:

There’s a lot of nuance both in making benchmarks (as we discovered with OpenAI on our SWE-Bench Verified podcast) and in extrapolating results from them, especially where exponentials and sigmoids are concerned. METR’s Long Horizons work itself has known biases that the authors have responsibly disclosed, but go far too underappreciated in the pursuit of doomer chart porn.

If you’re interested in a short, sharable TED talk version of this pod, over at AIE CODE we were blessed to feature Joel twice, as a stage talk and with a longer form small workshop with Q&A:

We also make sure cover some of METR’s lesser known work on Threat Evaluation but also Developer Productivity, where 2x friend of the pod and now Zyphra founder Quentin Anthony was the ONLY productive participant!

Finally, if you’re the sort to read these show notes to the end, then you definitely deserve some pictures of Joel shredding the guitar at Love Band Karaoke which we mention at the end:

Full Video Pod

Timestamps

00:00 What METR Means00:39 Podcast Intro With Joel01:39 ME vs TR03:33 Time Horizon Origin Story04:56 Picking Tasks And Biases09:13 Time Horizon Misconceptions11:37 Opus 4.5 And Trendlines14:27 Productivity Studies And Explosions29:50 Compute Slows Progress30:47 Algorithms Need Compute32:45 Industry Spend and Data34:57 Clusters and Shipping Timelines36:44 Prediction Markets for Models38:10 Ma