The Evil Tester Show
The Evil Tester Show

Mastering Automatability for Test Automation

December 12, 2025

AI Summary

5 min read

The episode captures a raw Q&A session on building effective test automation. The central thread is automatability—the developer's or team's practiced ability to structure, adapt, and execute automation—rather than reliance on any single tool or framework. The speaker draws on real project constraints to show how this ability reduces dependence on tools, improves workarounds, and supports decisions about what to automate at all.

Core Meaning of Automatability

Automatability begins with separating the skill of automating from the choice of tool. When teams develop this skill, they learn how to create abstraction layers, decide when an off-the-shelf solution is sufficient, and build code that remains maintainable under change. Without it, teams become locked into one tool's limitations and struggle when the application or environment deviates from expectations. The speaker notes that strong automatability lets practitioners handle cases others cannot, because they focus on understanding the target system and the mechanics of control rather than waiting for the next framework release.

Continue reading the full summary in the app — free to try.

Read Full Summary →

Free • No credit card required

What you'll learn

  • 1 (00:00) **Intro and session context** - Explains this is a raw recording of an AMA on test automation and automatability
  • 2 (01:26) **Core concept of automatability** - Why ability to automate matters more than tools when building a first framework
  • 3 (03:27) **Automation problems vs application design problems** - How to separate the two when teams confuse them
  • 4 (05:17) **Slow UIs and automatability** - Whether slowness is a testability, automatability, or broader issue
  • 5 (08:07) **Third-party widgets and payment gateways** - Strategies for handling components that are not automation-friendly
  • 6 (10:05) **Evaluating automation readiness** - Consultancy approach and what "ready to automate" actually means
  • 7 (12:16) **Failing architectural patterns in large-scale UI automation** - Common issues around environments, test data, and team ability

+ Full timestamped outline available in the app

Show Notes

The answers given during a Browserstack Community AMA session held on Discord on the 11th of December 2025, following a live LinkedIn video stream. The session focused on "Mastering Automatability for Test Automation". The main theme is the concept of Automatability, which I view as the ability to automate, this personal skill is more critical than reliance on specific tools. The discussion covers various topics, including how to separate automation problems from application design issues, dealing with slow UIs and non-automation friendly third-party widgets, evaluating automation readiness, and addressing common architectural failings related to large-scale UI automation.


00:00:00 Introduction

00:01:27 key early lesson about automatability?  

00:01:56 separating automation issues vs. design issues?  

00:03:49 is slow UI a testability or automatability problem?  

00:06:50 handling non-automatable third-party widgets?  

00:09:20 assessing automation readiness - any framework?  

00:11:23 common architectural patterns that break at scale?  

00:13:37 prioritizing testability vs. automation in sprints?  

00:16:51 do modern tools reduce the need for good design?  

00:19:32 explaining automatability as an investment?  

00:21:44 how do AI agents handle dynamic/third-party elements?  

00:23:17 early signs a feature will be flaky when automated?  

00:26:10 which microservice layers to automate first?  

00:29:16 high-ROI automatability fixes for small budgets?  

00:30:55 early dev–test collaboration to prevent rework?  

00:34:08 thinking about automatability in continuous delivery?

Join the BrowserStack Discord community and discover more AMA sessions https://www.browserstack.com/community

The Evil Tester Show

More from this podcast

The Evil Tester Show →