AI Summary
5 min readTobi Lütke: AI Agents, Better Decisions, and the Future of Work
When Shopify's internal AI agent River joined a Slack conversation, a developer asked her to do something obviously stupid. River told the person it was stupid. The exchange was hilarious, and people loved it. That moment captures something central to how Shopify's CEO Tobi Lütke thinks about AI: the industry's instinct to neuter machine personalities after Microsoft's Sydney chatbot scandal was a mistake, and Shopify deliberately went the other direction.
The River Operating System
Inside Shopify, roughly 50% of pull requests—the code changes that modify production systems—are now created not by engineers writing code traditionally, but out of conversations in the company's Slack channels. River, the company's internal AI agent, lives in those channels with 7,000 employees. She has a name, a profile picture, and is prompted to be sarcastic when appropriate. She also has memory, organized by channel, and access to all of Shopify's code, systems, and tools.
Continue reading the full summary in the app — free to try.
Read Full Summary →Free • No credit card required
Never miss an episode of The Knowledge Project
Get every new episode summarized in your inbox — free, ~5 minutes to read.
No spam. Unsubscribe anytime.
What you'll learn
- 1 (00:00) **Opening: Pruning and the State of AI at Shopify** - Tobi opens with the principle that you cannot improve things by addition alone; you must prune and rebuild. He then describes how Shopify is using AI internally, noting that a vanishingly small number of people now write code directly, instead working with dozens of AI agents per task.
- 2 (02:05) **The Forgotten Lessons of Computing History** - Tobi argues that the tech industry discards the great lessons of its pioneers (e.g., Alan Kay, Dennis Ritchie, Ken Thompson) and is forced to rediscover them repeatedly.
- 3 (05:16) **The Sydney Lesson and Why Shopify's AI Has Personality** - Tobi recounts the "Sydney" scandal (Microsoft's early chatbot) that had a real personality but was shut down for being too deranged, arguing this was a mistake.
- 4 (08:56) **Why River Works in the Open** - Tobi explains the deliberate choice to have River operate only in public channels, not private DMs.
- 5 (10:57) **River as the Operating System: Memory and Self-Reflection** - Tobi describes River's memory system, which works by "dreaming" at night—reviewing conversations, identifying what went well or poorly, and improving its own skills.
- 6 (12:00) **Using AI for Better Decisions, Not Just Code** - Tobi explains how he uses AI to augment his own judgment and decision-making, not to replace it.
- 7 (14:00) **The Irreplaceable Human Element: Responsibility** - Tobi argues that machines cannot take responsibility, which is the most overlooked aspect of the AI stack.
+ Full timestamped outline available in the app
Guests on this episode
Show Notes
Shopify founder and CEO Tobi Lütke joins Shane Parrish to discuss AI agents, better decision-making, and the future of work. He explains how he uses an AI council to examine his hardest decisions and why taste, judgment, and responsibility become more valuable as AI becomes more capable.
They go inside Shopify’s work with River, an AI colleague with memory, personality, and permission to challenge the CEO. They explore how to choose between several good options, why the best long-term decisions often lack immediate feedback, and why building something that lasts requires pruning and rebuilding.
Tobi also shares how he cultivates intuition, the affirmations he uses to change his own behavior, and why his kids must add “yet” when they say they can’t do something.
Enjoy!
-----
Chapters:
(00:00) Introduction
(3:46) The Case for Skeuomorphism
(5:16) How Bing's Chatbot "Sydney" Inspired Shopify's AI
(7:18) River: Shopify's Internal AI
(8:55) How to Encourage Osmosis Learning
(10:52) AI Dreaming and Self-Reflection
(11:53) How to Use AI for Strategic Decision Making
(14:11) The One Thing AI Cannot Do
(16:04) What AI is Making Worse at Shopify
(19:46) Predictions: Where AI is Headed Next
(21:55) The Future of AI-Powered Software
(24:40) Will CEOs Be Replaced with AI?
(27:54) Can Superintelligence Be Controlled?
(31:13) Critical Skills in AI Age
(34:22) Why Complex Solutions are Usually Wrong
(36:33) Conditions Needed for True Intuition
(38:02) The Optimal Path Doesn't Have Instant Feedback
(44:51) How Affirmations Can Shift Your Behavior
(50:44) The Inobvious Thing Hurting Companies
(52:37) Relationship Between Beauty and Creation
(56:23) How SpaceX Moves Forward By Subtraction
(1:00:24) Why Companies Need Refounding Events
(1:01:50) Use Books as Cheat Codes
(1:02:39) Three Books That Change Your Thinking
-----
Follow Tobi:
------
Newsletter: The Brain Food newsletter delivers actionable insights and thoughtful ideas every Sunday. It takes 5 minutes to read, and it’s completely free. Learn more and sign up at fs.blog/newsletter
------
Follow Shane Parrish:
X: https://x.com/shaneparrish
Instagram: https://www.instagram.com/farnamstreet/
LinkedIn: https://www.linkedin.com/in/shane-parrish-050a2183/
-----
+ Members get the longer, extended version of this conversation, with additional content not included in the public release.Lea
More from this podcast
The Knowledge Project →