AI Testing Is Bigger Than You Think, 5 Areas Testers Must Own with Swati Seela

About This Episode:

Most testers are stuck arguing about whether AI is coming for their jobs. Swati Seela thinks that’s a distraction from a much more useful question: when we say “AI testing," what do we actually mean?

What do you think? Take our TestGuild State of Test Automation Survey now: https://testgld.link/27data

In this episode, Swati walks through the AI Testing Landscape, a practical framework she presented at CAST 2026 that breaks AI testing into five overlapping areas: AI assisted testing, AI evaluation and trust, AI development quality, testing products that contain AI functionality, and testing the AI models themselves. Each one has a different test intent, a different technique, and a different toolset, which is exactly why lumping them together leaves new testers with no idea where to start.

Along the way Swati gets specific about the failure modes she keeps hitting in real work.

• Why AI opens almost every response by agreeing with you, and why that false sense of correctness is the modern version of a green dashboard hiding tests that stopped meaning anything years ago.
• Why her MCP test generator kept skipping the cataloging step, what that revealed about models trading completeness for speed, and how splitting one workflow into two got her reliability back.
• Why traditional Boolean assertions break down against probabilistic systems, and what your automation framework has to do instead.

She also shares how she uses AI to learn hard material in the semiconductor world without losing the thread, what she absolutely will not accept without laying eyes on it herself, and her answer to whether a tester with a decade of experience should be worried right now.

Her closing advice comes down to two things that have to travel together: testing fundamentals, and AI literacy. Don’t hate it, don’t love it, just use it.

Discover links to all the resources mentioned in this episode below.

0:00 / 0:00

Join the Guild for (FREE)!

Email New Tab

Exclusive Sponsor

TestGuild State of Automation Survey

What is actually working in test automation right now, and what is quietly falling apart? Every year I ask thousands of testers, automation engineers, and QA leaders that exact question, and every year the answers surprise me. Which frameworks teams are really running. Where AI adoption is stalling out. How much of your week is disappearing into test maintenance. It takes just a few minutes, it’s completely anonymous, and the full report drops in January. Add your voice at: https://testgld.link/27data

About Swati Seela

Swati Seela is a principal software quality engineer, author, and speaker with more than 20 years of experience in software testing, automation, and quality engineering. Swati has been developing a practical framework called the AI Testing Landscape, which maps five distinct but overlapping areas where testers can contribute—from using AI to augment testing to evaluating AI products, models, trust, and development quality. She recently presented this work at CAST 2026, and today we’re going to explore a provocative question: Are we thinking too small about AI testing?

Connect with Swati Seela

• • LinkedIn: www.swatiseela

Rate and Review TestGuild

Thanks again for listening to the show. If it has helped you in any way, shape, or form, please share it using the social media buttons you see on the page. Additionally, reviews for the podcast on iTunes are extremely helpful and greatly appreciated! They do matter in the rankings of the show and I read each and every one of them.