Automation Testing Podcast Automation Episode 586

Claude AI Mobile Testing, Run Real Device Tests with AI

with Frank Moyer & Chris Faulhaber

founder · Kobiton and a long-time leader at the intersection of AI and software quality

April 28, 2026 Hosted by Joe Colantonio

Claude AI Mobile Testing, Run Real Device Tests with AI

0:000:00

Key takeaways

What you'll learn in this episode

How teams are generating and running Appium tests using natural language in minutes

Why AI-generated tests often fail—and how to avoid costly false positive

The real impact of AI on test automation roles and responsibilities

How real device testing exposes issues AI alone can’t catch

Practical ways to reduce test maintenance while increasing coverage

About this episode

AI is changing how we build and test software,but most teams are still struggling to turn AI-generated tests into real production value.
Use code TESTGUILD3 try for yourself free now for 3 months: https://links.testguild.com/Kobiton
In this episode, we break down what actually works when it comes to AI-powered mobile test automation, especially when running tests on real devices not simulators from Claude.

We also explore a major shift happening right now:

AI is making it easier to create tests—but dramatically increasing the volume of code and risk that needs to be validated.
That means one thing:

Testing isn’t going away—it’s becoming more critical than ever.

If you’re a QA engineer, automation engineer, or DevOps leader trying to keep up with AI-driven development, this episode will give you a clear, practical perspective on what to focus on next.

Company: Kobiton https://kobiton.com/

Blog: https://kobiton.com/blog/

LinkedIn: https://www.linkedin.com/in/frankmoyer/

Twitter: https://twitter.com/fwmoyer

YouTube:https://www.youtube.com/c/Kobiton

About the guest

About Frank Moyer

founder · Kobiton and a long-time leader at the intersection of AI and software quality

Frank Moyer is the founder of Kobiton and a long-time leader at the intersection of AI and software quality. He began his AI career at Columbia University in the late 1980s and entered the world of enterprise testing at Accenture in the early 1990s, later pioneering one of the industry’s first AI-driven automation tools with Kobiton’s Appium Script Generator in 2020. Frank now coaches global engineering teams to help automation engineers embrace AI, expand their impact, and accelerate their careers in this AI era of testing.

About the guest

About Chris Faulhaber

author · Xium

Chris Faulhaber is Lead Architect at Kobiton, operating at the intersection of mobile and AI to solve the hard problem of capturing device exhaust from real mobile devices and feeding it into AI inference systems. He leads core device engineering and is the author of Xium, a high-performance Appium/WebDriver server replacement. Chris works deep in the mobile stack, implementing and reverse engineering low-level iOS and Android protocols to enable reliable, scalable automation on real devices.

Exclusive sponsor

Kobiton just launched a Claude Code plugin that lets you create, debug, and run mobile tests on real devices using plain English, right inside Claude. No new tools, no Appium headaches, just prompt, test, ship. And they're giving the TestGuild community 3 months to actually run this in your real workflow. Use code TESTGUILD3 at the link in the show notes down below.

https://links.testguild.com/Kobiton

Learn more