Acquired
Acquired

Google Part III: The AI Company

October 6, 2025

AI Summary

5 min read

The Innovator's Dilemma at Google Scale

In 2017, eight researchers at Google Brain published a paper called "Attention Is All You Need," describing a new neural network architecture called the Transformer. Today, that paper has been cited over 173,000 times and sits at the foundation of the entire AI revolution—ChatGPT, Claude, Gemini, all of it. But here is the uncomfortable question at the heart of Google's story: what happens when a company invents the future but hesitates to embrace it because the present is too profitable?

Google's dilemma is almost a textbook case of Clayton Christensen's innovator's dilemma. The company had the densest concentration of AI talent in the world a decade ago. It had the infrastructure, the data, the chips, and the cloud. It still owns the text box that is the front door to the internet for the vast majority of people. Yet when OpenAI launched ChatGPT in November 2022 and it became the fastest product in history to reach 100 million users, Google was caught flat-footed. The company that invented the Transformer had to scramble to respond to a startup that had commercialized it.

The Long Road from PageRank to the Transformer

Continue reading the full summary in the app — free to try.

Read Full Summary →

Free • No credit card required

Listen to Audio Summary Open in App

What you'll learn

  • 1 (00:40) **The Innovator's Dilemma** - Ben and David frame the central question: Google has a monopoly cash cow (search) and invented the transformer, but the new AI product is far less profitable. Should they risk it all?
  • 2 (06:01) **Google's AI Talent Monopoly** - A decade ago, every major AI figure (Ilya Sutskever, Dario Amodei, Andrej Karpathy, Demis Hassabis) worked at Google.
  • 3 (08:27) **The Seed: Larry Page's AI Vision & The Micro-Kitchen Idea** - Larry Page always saw Google as an AI company. In 2001, engineers Noam Shazeer and George Herrick explore the idea that compressing data is equivalent to understanding it.
  • 4 (18:11) **The Translate Breakthrough & Jeff Dean's Parallelization** - In 2007, Franz Och's massive language model for Google Translate is too slow (12 hours per sentence). Jeff Dean re-architects it to run in parallel, dropping latency to 100 milliseconds.
  • 5 (23:47) **The Academic Pipeline & The Godfather** - Larry Page hires Sebastian Thrun from Stanford, who brings in a network of AI professors. In 2007, Jeff Hinton gives a tech talk at Google, eventually becoming a consultant and then an intern.
  • 6 (34:55) **Google Brain & The Cat Paper** - Andrew Ng and Jeff Dean launch Google Brain in 2011. They build "DistBelief," a distributed system that trains a neural network to recognize cats from unlabeled YouTube videos.
  • 7 (47:02) **AlexNet & The GPU Revolution** - Jeff Hinton's team at Toronto uses two NVIDIA gaming GPUs to win the ImageNet competition by 40%, proving deep neural networks can run on GPUs.

+ Full timestamped outline available in the app

Show Notes

Google faces the greatest innovator's dilemma in history. They invented the Transformer — the breakthrough technology powering every modern AI system from ChatGPT to Claude (and, of course, Gemini). They employed nearly all the top AI talent: Ilya Sutskever, Geoff Hinton, Demis Hassabis, Dario Amodei — more or less everyone who leads modern AI worked at Google circa 2014. They built the best dedicated AI infrastructure (TPUs!) and deployed AI at massive scale years before anyone else. And yet... the launch of ChatGPT in November 2022 caught them completely flat-footed. How on earth did the greatest business in history wind up playing catch-up to a nonprofit-turned-startup?

Today we tell the complete story of Google's 20+ year AI journey: from their first tiny language model in 2001 through the creation Google Brain, the birth of the transformer, the talent exodus to OpenAI (sparked by Elon Musk's fury over Google’s DeepMind acquisition), and their current all-hands-on-deck response with Gemini. And oh yeah — a little business called Waymo that went from crazy moonshot idea to doing more rides than Lyft in San Francisco, potentially building another Google-sized business within Google. This is the story of how the world's greatest business faces its greatest test: can they disrupt themselves without losing their $140B annual profit-generating machine in Search?

Sponsors:

Links: