AI Summary
5 min read“Humans are not experts in everything. But in the field there are experts, they're very good sometimes better than our super huge models. So it exists. I don't think we have found it technically.” That is Lucas Kaiser, co-author of the landmark “Attention Is All You Need” paper, speaking at the Open Source AI Summit in San Francisco. He is making a deceptively simple point: the human brain is proof that a radically more efficient learning algorithm exists—one that does not require scraping the entire internet or spending billions of dollars. The current concentration of AI power in a few giant companies, he argues, is a feature of today’s dominant technology, the transformer, not an inevitable property of intelligence itself.
Why AI Power Is Concentrated Right Now
Continue reading the full summary in the app — free to try.
Read Full Summary →Free • No credit card required
Never miss an episode of a16z Show
Get every new episode summarized in your inbox — free, ~5 minutes to read.
No spam. Unsubscribe anytime.
What you'll learn
- 1 (00:00) **Episode Introduction** - Host Sophia Dew sets up the central tension: AI is growing more powerful, but the resources needed to build it are concentrating.
- 2 (01:04) **Where Power Is Concentrating Now** - Lucas Kaiser describes the current dynamic where coding agents started working, driving a need for expensive data centers and massive data scraping.
- 3 (02:10) **Transformers Are Not the Final Word** - Lucas argues that the current concentration is a feature of the transformer architecture, which is less than 10 years old and may be superseded.
- 4 (02:57) **The Proof of a Better Algorithm** - Lucas points to human intelligence as existence proof that a more efficient learning algorithm exists.
- 5 (03:48) **Open Source's Window of Opportunity** - Lucas explains that as big labs shift focus to products, open source and academia have a chance to drive fundamental research.
- 6 (04:27) **Why Lucas Is Optimistic** - Lucas concludes by explaining his optimism for a distributed, open future for AI.
- 7 (05:59) **A Call to Look Ahead** - Lucas urges listeners not to be pessimistic about the current concentration, which he sees as a convenient step that showed what's possible.
+ Full timestamped outline available in the app
Show Notes
MTS host Sophia Dew visits the Open Source AI Summit in San Francisco to ask researchers and founders across the AI stack a central question: can open source prevent AI power from concentrating in the hands of a few companies?
Lukasz Kaiser, co-author of Attention Is All You Need, argues that today’s concentration may be a feature of the current technological paradigm rather than a permanent feature of AI. Transformers reward enormous amounts of data and compute, but future breakthroughs could make smaller, more specialized models far more capable.
Across conversations with researchers and builders working on open models, infrastructure, and applications, Sophia explores why China has taken the lead in open-weight models, whether the U.S. needs more open-model startups, what it means for companies to own their own intelligence, and where openness alone falls short, particularly when access to compute remains concentrated.
Resources:
Follow Lukasz Kaiser on X: https://x.com/lukaszkaiser
Follow Sophia Dew on X: https://x.com/sophiadew
Follow MTS on X: https://x.com/mtslive
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
More from this podcast
a16z Show →