AI Summary
5 min readThe Test Automation Pyramid: A Model Misunderstood
Alan Richardson opens with a confession: he has never been a fan of the test automation pyramid. But after rereading the original source — Mike Cohn's 2008 book Succeeding with Agile — he realized his problem was not with Cohn's model, but with how everyone else had mangled it. The diagram that gets passed around at conferences and in blog posts is almost never Cohn's actual model. It is someone else's reinterpretation, still bearing Cohn's name, but carrying different assumptions, different definitions, and different implications.
The Original Model vs. The Proliferation of Variants
Cohn's original diagram had three layers: UI level, service level, and unit level. It appeared in chapter 16 of Succeeding with Agile, a throwaway diagram to make a simple point about automating at different levels. The variants that have since proliferated replace "service level" with API tests, integration tests, system tests, or component tests. Some add manual testing on top. Others swap in acceptance tests and unit tests. None of these are Cohn's model. They are new models that borrow the diagram but carry different assumptions.
Continue reading the full summary in the app — free to try.
Read Full Summary →Free • No credit card required
Never miss an episode of The Evil Tester Show
Get every new episode summarized in your inbox — free, ~5 minutes to read.
No spam. Unsubscribe anytime.
What you'll learn
- 1 (00:00) **Episode Introduction** - Alan Richardson introduces the topic: the Test Automation Pyramid, its 2008-2009 origin, misinterpretations, and his 2023 interpretation.
- 2 (00:41) **Origin of the Model** - The model started in Mike Cohn's book "Succeeding with Agile" (2008-2009).
- 3 (01:43) **The Core Problem: Misinterpretation** - Alan's aversion stems from the many variants, not Mike Cohn's original model.
- 4 (02:32) **The "Test" vs. "Automation" Misdirection** - The focus on "test" in the name has caused confusion.
- 5 (03:25) **Alan's Reframing: Automated Execution X-Unit Coverage Model** - A more accurate, if clunky, name.
- 6 (04:08) **The "Service Level" Ambiguity** - The term "service level" is the root of much misinterpretation.
- 7 (04:36) **Diagram vs. Model** - A critical distinction.
+ Full timestamped outline available in the app
Show Notes
This episode covers the Test Automation Pyramid, created by Mike Cohen in 2008-2009 in the book "Succeeding With Agile". We will go beyond the diagram and look at the model that supports it. Then deep dive into the model to explore it's meaning in relation to Automated Execution Coverage, not Testing.
- The model was created by Mike Cohen in 2008-2009 in the book "Succeeding With Agile."
- The original model focused on UI, service level, and unit level automation.
- Over the years, different interpretations and variations of the model have emerged.
- The term "service level" in the model has led to ambiguity and different interpretations.
- The diagram in the model is a simplified representation of a deeper underlying model.
- The focus should be on achieving coverage at the most appropriate level in the system.
- The model addresses the importance of avoiding duplication and redundancy in automated coverage.
- The process and team structure can impact the effectiveness of the model.
- The model can be reframed as an automated execution coverage pyramid.
More from this podcast
The Evil Tester Show →