AI Summary
5 min readIn 2005, Matt Garman was a business school intern at what was then an internal Amazon project called AWS. His assignment: figure out who the service would be most useful for. The answer was startups. Nearly two decades later, Garman is CEO of AWS, a business approaching $170 billion in annual revenue, and the calculus around startups has changed dramatically. Today, those two-person teams arrive with $200 million in funding and a billion-dollar valuation, and their first ask is often for GPUs. In a conversation with a16z’s Ragu Raghuram, Garman walked through the massive infrastructure buildout underway—$220 billion in CapEx for 2026 alone—and how AI is reshaping not just the cloud’s customers, but the cloud itself.
The New Startup: Bigger Ambition, Same Need for Depth
The startups AWS serves today are fundamentally different from the ones that built the early cloud. They start larger, with more capital and more expensive ideas—training a foundation model is not the same as iterating on a mobile app. But Garman emphasized that some things haven’t changed. These companies still need an architecture that scales, proper security and IAM setups, and a platform that works for more than just three employees. That, he argued, is why many choose AWS over a “neo cloud” provider: they need the depth of services from day one, even if they don’t need all of it immediately.
Continue reading the full summary in the app — free to try.
Read Full Summary →Free • No credit card required
Never miss an episode of a16z Show
Get every new episode summarized in your inbox — free, ~5 minutes to read.
No spam. Unsubscribe anytime.
What you'll learn
- 1 (00:00) **Introduction & the Startup DNA of AWS** - Raguram and Matt Garman set up the conversation, tracing AWS's origin back to EC2 in 2006 and its enduring relationship with startups.
- 2 (06:48) **The Agentic Cloud: New Demands & New Services** - The conversation shifts to how the rise of AI agents is changing what customers need from a cloud provider.
- 3 (09:04) **Redesigning for Agent On-Ramps** - Matt details the specific architectural and usability changes AWS is making to accommodate agents.
- 4 (15:48) **The GPU Allocation Dilemma** - Raguram asks the critical question of how AWS balances GPU supply between massive frontier labs and promising startups.
- 5 (20:03) **On Capital Allocation and Avoiding a Bubble** - Matt explains how AWS's diversified approach to its massive infrastructure investments protects it from a potential AI bubble.
- 6 (24:13) **Evolving from Server Planning to Power Planning** - The scale of the buildout has fundamentally changed AWS's planning processes.
- 7 (29:32) **The PR Problem of Data Centers** - Matt addresses the negative public perception of data centers and the industry's failure to communicate their benefits.
+ Full timestamped outline available in the app
Show Notes
a16z’s Raghu Raghuram sits down with AWS CEO Matt Garman to discuss how AI is reshaping the cloud, from the needs of AI-native startups to infrastructure increasingly designed for agents.
Matt explains how AWS is adapting as agents write code and manage infrastructure, why it’s reserving scarce GPU capacity for startups, and where custom chips like Trainium and Graviton fit into the AI stack.
They also discuss Amazon's $220 billion capital investment, the shifting bottlenecks in the infrastructure buildout, what enterprises need to trust autonomous agents, and how AWS's own teams are building with agents.
Resources:
Follow Matt Garman on X: https://x.com/mattsgarman
Follow Matt Garman on LinkedIn: https://www.linkedin.com/in/mattgarman
Follow Raghu Raghuram on X: https://x.com/RaghuRaghuram
Learn more about AWS: https://aws.amazon.com/
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.