How Foundation Models Evolved: A PhD Journey Through AI's Breakthrough Era

January 16, 2026

AI Summary

5 min read

🎙️ The Voices & The Context

The Format: A structured interview between host and guest, blending casual banter with deep technical dives into AI frameworks and philosophy.
The Key Players:
- Guest: Omar Katab, MIT assistant professor (EECS), PhD from Stanford, creator of DSPy—a widely-used open-source framework for LLM programming and prompt optimization. Famous for challenging AGI hype and pushing "artificial programmable intelligence."
- Host: Martin Casado, a16z general partner, with shared tech roots; fosters insightful back-and-forth on AI systems vs. raw models.
The Vibe: Educational and intellectual, optimistic yet skeptical—fun analogies keep it engaging, like debating AGI over coffee.

🗝️ Key Themes & Topics

The episode critiques the AGI race, advocating programmable systems over god-like models. Core discussion: LLMs need better abstractions for human intent, not just scaling.

Topic 1: AGI Skepticism & Scaling Limits
Omar pushes back on "scaling is all you need," noting labs have shifted to post-training, tools, and agents. Intelligence alone isn't enough—specification (expressing intent) is the bottleneck. Nobody wants raw intelligence; they want reliable systems like software.

Continue reading the full summary in the app — free to try.

Read Full Summary →

Free • No credit card required

Listen to Audio Summary Open in App

What you'll learn

1 (00:00) **🎙️ Introduction: Omar Katab**
2 (04:12) **AGI Debate and Scaling Limits**
3 (08:25) **Views on Model Architectures**
4 (10:37) **Why Build Programmable Systems**
5 (14:16) **AI System Stack and Specification**
6 (21:24) **Introduction to DSPy Framework**
7 (24:24) **DSPy's Core Abstractions**

+ Full timestamped outline available in the app

Show Notes

The Stanford PhD who built DSPy thought he was just creating better prompts—until he realized he'd accidentally invented a new paradigm that makes LLMs actually programmable.

While everyone obsesses over whether LLMs will get us to AGI, Omar Khattab is solving a more urgent problem: the gap between what you want AI to do and your ability to tell it, the absence of a real programming language for intent. He argues the entire field has been approaching this backwards, treating natural language prompts as the interface when we actually need something between imperative code and pure English, and the implications could determine whether AI systems remain unpredictable black boxes or become the reliable infrastructure layer everyone's betting on.

Follow Omar Khattab on X: https://x.com/lateinteraction

Follow Martin Casado on X: https://x.com/martin_casado

Check out everything a16z is doing with artificial intelligence here, including articles, projects, and more podcasts.

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

Stay Updated:

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Show on Spotify

Listen to the a16z Show on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.