AB Testing
AB Testing

Episode 230: Kat Obring is Back

May 5, 2026

AI Summary

5 min read

The conversation between host Alan Page and returning guest Kat Obring centers on how testers and quality practitioners can make sound decisions when integrating AI tools into their work. Obring, who runs Keto Coaching and focuses on workshops for teams, describes a shift from earlier topics like whole-team quality ownership to current pressures created by generative AI. Both speakers stress that AI amplifies the need for careful judgment rather than replacing it, and they examine the psychological patterns that either help or hinder effective use.

Decision-making patterns under AI pressure
Obring draws on Daniel Kahneman’s distinction between system 1 (fast, automatic responses) and system 2 (slow, deliberate analysis) to explain common reactions to AI. Many teams default to system 1 impulses: either declaring that AI can handle all testing or insisting it cannot be trusted for any task. These reactions bypass the step of defining a desired outcome first. Obring recommends simple reflective sequences—ask, reflect, respond—that move thinking into system 2 territory. The same approach applies when prompting models: stating a narrow goal, specifying acceptable levels of hallucination or rework, and checking results against that goal reduces impulsive acceptance or dismissal of output.

Continue reading the full summary in the app — free to try.

Read Full Summary →

Free • No credit card required

What you'll learn

  • 1 (00:41) **Kat Obring's background and current focus** - Founder of Keto Coaching delivering workshops on decision-making around QA and quality
  • 2 (02:05) **Responsible vs. over-reliant use of AI** - Why both over-trusting and outright rejecting AI are problematic
  • 3 (06:40) **The false dichotomy in AI testing** - Rejecting the "AI replaces all testers" vs. "AI can't be trusted at all" camps
  • 4 (07:34) **AI for removing low-value friction** - Example of building an agent to automate monthly invoicing from CSV
  • 5 (10:03) **Core theme: decision-making frameworks** - Moving from System 1 (fast, impulsive) to System 2 (deliberate) thinking
  • 6 (13:41) **Defining good outcomes before using AI** - Questions to ask: acceptable hallucination rate, rework tolerance, time investment
  • 7 (16:16) **AI as collaborative thinking partner** - Using GenAI to generate test ideas then probe for missed risks

+ Full timestamped outline available in the app

Show Notes

In this insightful interview, Kat Obring discusses the evolving role of AI in testing and quality assurance, emphasizing good decision-making, automation, and the future of team collaboration. The conversation explores practical AI applications, decision frameworks, and how testers can stay relevant in a fast-changing landscape.


More from Kat

  • https://www.linkedin.com/in/katjaobring/
  • https://kato-coaching.com/
AB Testing

More from this podcast

AB Testing →