20VC: Horizontal vs Vertical Agents: Who Wins | Model Routing: Commodity or Increasing in Value | The Future of the Inference Market | Why Founders Should Take Discounts for Tier 1 Firms with Harrison Chase, LangChain
October 17, 2026
AI Summary
5 min readWhy Agents Are Still Hard, and Where the Value Actually Lives
Harrison Chase, founder of LangChain, estimates his company spends roughly 30% of engineering salary on coding tools — and that figure has actually gone down in recent months even as token usage has climbed. That single data point captures a central tension in the current AI landscape: demand for inference is exploding, costs are rising, but the tools to control those costs are only beginning to emerge. Chase's position running the most widely used framework for building LLM agents gives him an unusually clear view of where the real bottlenecks and opportunities lie.
The Fundamental Difficulty of Building Agents
The core problem with agents is straightforward but often underestimated. LLMs are non-deterministic black boxes that take natural language as input and produce natural language as output. The input space is effectively infinite — put a chatbot in front of someone and they can type anything — and the output space is similarly unbounded because similar inputs can produce completely different answers. When you chain multiple model calls together and have them interact with external tools, you get "cascading types of errors" that make the overall system non-robust.
Continue reading the full summary in the app — free to try.
Read Full Summary →Free • No credit card required
Never miss an episode of The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
Get every new episode summarized in your inbox — free, ~5 minutes to read.
No spam. Unsubscribe anytime.
What you'll learn
- 1 (04:30) **What LangChain Builds & Why Agents Are So Hard** - Harrison defines LangChain’s two products: an open-source framework for connecting models to tools/data, and LangSmith for observability and evals. He then explains the core difficulty of building agents: LLMs are non-deterministic black boxes with infinite input spaces, leading to cascading errors in multi-call agent systems.
- 2 (06:29) **How Model Improvement Forces Product Erasure** - Harrison explains that as models get smarter, LangChain must constantly delete large parts of its product that are no longer needed, similar to Cursor’s “delete the product” operating principle.
- 3 (08:50) **Why the World Needs Neutral Harnesses** - Harrison argues that neutral harnesses are essential because agents build up state (memory, context) over time, and you don’t want that state locked to a single model provider.
- 4 (10:46) **What It Means to “Own Your Intelligence”** - Harrison breaks down owning your intelligence into controlling three layers: the model, the harness, and the context. Most companies should start at the context/harness layer before touching model weights.
- 5 (11:56) **Where Agent Value Really Lives: Verification & Vertical Agents** - Harrison argues that if value is derived from verification (knowing whether the agent did well), the winners will be domain experts who can write those verifiers.
- 6 (13:16) **The Reality of “Building Your Own Model”** - Harrison clarifies that most companies like Harvey and Ramp are not training models from scratch — they are post-training open-weight models (often Chinese open-source models), which is a valuable but later-stage optimization.
- 7 (16:29) **Model Routing: Where It Belongs and Why It’s Not a Commodity** - Harrison dives into the debate: should model routing live at the gateway layer (simple API call, portable) or the harness layer (more state-aware)?
+ Full timestamped outline available in the app
Show Notes
Harrison Chase is the co-founder and CEO of LangChain, which helps developers build, test and deploy AI agents.
Backed by Sequoia Capital, Benchmark and IVP, LangChain has announced approximately $160 million in funding with the last round at a $1.25BN valuation. The company works with 35% of the Fortune 500, has surpassed one billion open-source downloads and processes over one billion events daily through LangSmith.
AGENDA:
04:10 Why Is It Still So Hard to Build AI Agents?
08:50 Will the Model Labs Eat the Agent Stack?
16:25 Is Model Routing a Real Business or a Commodity?
25:45 Why Has No One Solved AI Memory?
35:45 Why Are AI Bills Exploding as Tokens Get Cheaper?
43:25 Should Companies Be Afraid of Chinese AI Models?
46:20 Where Would Harrison Not Be Investing Today?
53:05 Should Founders Take a Discount for Benchmark and Sequoia?
57:35 OpenAI at $1.5T or Anthropic at $2T: Which Would You Buy?
More from this podcast
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch →