Podcast

AI Testing Costs, How to Prevent Runaway Token Bills with Arthur Hicken

13 May 2026 at 4:24 AM
By Test Guild
  • Share:
AI Testing Costs, How to Prevent Runaway Token Bills with Arthur Hicken

About This Episode:

AI-powered testing tools are exploding across software engineering teams… but so are the hidden costs.
In this episode, Joe sits down with Arthur Hicken to unpack the growing problem of runaway AI token usage, unexpected LLM billing, and the operational risks of deploying AI agents into testing and DevOps pipelines. Inspired by Arthur’s article on the emerging “Token Tax,” this conversation explores why many teams are underestimating the true cost of AI automation.
You’ll learn:
Why AI-generated testing can create unexpected scaling costs
How runaway AI agents and infinite loops happen
Real-world examples of massive AI billing surprises
Why deterministic problems shouldn’t always use LLMs
The hidden risks of “vibe testing” and autonomous AI remediation
How QA teams can monitor, test, and control token usage
Why performance testing and service virtualization matter more than ever in AI systems
Practical strategies to avoid expensive AI deployment mistakes
Whether you’re a software tester, automation engineer, QA leader, or DevOps practitioner, this episode will help you think more strategically about AI testing before costs spiral out of control.

Exclusive Sponsor

About Arthur Hicken

Arthur Hicken Headshot
Arthur Hicken is an evangelist at Parasoft where he has been involved in automating various software development practices for over 30 years. He has worked on projects including the software development life cycle, application security, functional safety, and software safety in industries like automotive, aerospace, and medical.
Arthur’s popular blog, Code Curmudgeon, is known for its Hall-of-Shame lists covering SQL injection and IoT vulnerabilities. He also has a YouTube channel with software development and AppSec videos. As an expert in his field, Arthur speaks frequently at conferences on development strategies, compliance, and security best practices. He’s involved with software safety and security standards as a member of organizations like CERT, IEEE, UL, and ASQ.

Connect with Arthur Hicken

Rate and Review TestGuild

Thanks again for listening to the show. If it has helped you in any way, shape, or form, please share it using the social media buttons you see on the page. Additionally, reviews for the podcast on iTunes are extremely helpful and greatly appreciated! They do matter in the rankings of the show and I read each and every one of them.

Related Podcasts

Scary Test Automation POCs Made Easy: Halloween Special With Paul Grossman
Automation Testing Podcast
October 20, 2026

About This Episode: Running a proof of concept on test automation tools can feel like a horror movie. Vendors promise […]

Locust and Azure Load Testing: Create and Debug Load Tests with AI with Lars Holmberg and Abhinav Premsekhar
Automation Testing Podcast
October 6, 2026

About This Episode: Performance testing has never been easier to start, or more important to get right. As teams ship […]

AI Agents Passed the Tests. Real Devices Didn’t. with Nick Metcalfe
Automation Testing Podcast
September 29, 2026

About This Episode: Cloud device farms make it easy to get started with real device testing. But what happens when […]

AI Testing Reality Check: What 13 Founders Refuse to Automate with Joe Colantonio
Automation Testing Podcast
September 22, 2026

About This Episode: I asked thirteen people inside AI testing one question: can AI test your software for you? Founders, […]