AI Summary
5 min readThe one AI detector people actually trust
When Max Spiro, CEO of Pangram, describes his job, he calls himself a "slop janitor." It is a deliberately unglamorous title for a company that has quietly become the most trusted name in AI text detection—a field that, until recently, was widely considered unreliable. The shift happened gradually. For two years, Pangram was just another startup publishing technical reports that nobody read. Then independent researchers started benchmarking it and publishing results. Suddenly, the conversation changed from "AI detectors don't work" to "well, Pangram says it's AI."
How Pangram actually works
The key innovation is not a clever algorithm but a training strategy called active learning. Most early AI detectors relied on a single metric called perplexity—a measure of how surprising a piece of text is to a language model. The logic was simple: AI models are trained to produce unsurprising, low-perplexity sentences, while humans write in more surprising ways. This approach broke down in predictable ways. The Declaration of Independence gets flagged as AI because the model has memorized it. English language learners get flagged because they write in simple, predictable prose. And as Spiro put it, "perplexity is not really a metric that can be improved upon. It's like measuring the density of a liquid."
Continue reading the full summary in the app — free to try.
Read Full Summary →Free • No credit card required
Never miss an episode of The Vergecast
Get every new episode summarized in your inbox — free, ~5 minutes to read.
No spam. Unsubscribe anytime.
What you'll learn
- 1 (04:31) **Max Biro, CEO of Pangram, Joins** - Introduction of the CEO of the AI detection tool that has gained a reputation for trustworthiness.
- 2 (06:12) **The Core Technology: Active Learning & Synthetic Mirrors** - Explanation of how Pangram achieves its low false positive rate.
- 3 (09:46) **The Black Box Problem** - Pangram provides "supporting evidence" but cannot definitively say what the model is looking at.
- 4 (13:00) **Why Other Detectors Fail: The Perplexity Problem** - The flaw in early AI detectors that relied on a single metric.
- 5 (15:36) **How to Trust a Pangram Result** - Practical guidance on interpreting the tool's output.
- 6 (22:14) **Case Study: The Serpent in the Grove Scandal** - Analysis of a controversial AI-detection case involving a prize-winning short story.
- 7 (25:37) **Who Uses Pangram?** - The primary industries and use cases for the tool.
+ Full timestamped outline available in the app
Show Notes
AI text detectors have been notoriously unreliable, but that's starting to change. This year, Pangram keeps coming up as the trusted source in identifying AI-written text. We sit down with Pangram CEO Max Spero to find out how the system was made, how much we should trust it, and where the line is between useful AI and AI slop.
Further reading:
Subscribe to The Verge for unlimited access to theverge.com, subscriber-exclusive newsletters, and our ad-free podcast feed.
We love hearing from you! Email your questions and thoughts to [email protected] or call us at 866-VERGE11.
Learn more about your ad choices. Visit podcastchoices.com/adchoices
More from this podcast
The Vergecast →