Scary Test Automation POCs Made Easy: Halloween Special With Paul Grossman

About This Episode:

Running a proof of concept on test automation tools can feel like a horror movie. Vendors promise everything, your boss wants answers fast, and you don’t know what you don’t know. In this Halloween special, Paul Grossman, the Dark Arts Wizard, walks through his free personal automation tool POC checklist and shares the AI and Playwright tricks he’s picked up this year.

Key takeaways:

• Use a 177 feature checklist to compare tools side by side, saved locally so your data stays yours, with room to add any tool you find.
• See how AI driven and codeless tools stack up on build time and run time using Paul’s 10 step Candy Mapper challenge.
• Practice on sandbox sites like Candy Mapper, Ministry of Testing’s Shady Acres, and the SelectorsHub shadow DOM page.
• Save tokens and time with Copilot CLI, and keep your AI on your rules with a copilot instructions file in .github.
• Catch disappearing toast messages with Playwright listeners and use slowMo to stop false failures on fast loading pages.
• Why AI won’t replace exploratory testers, plus the AI code reviewer “death spiral” Paul ran into.

Plus a Halloween lightning round: the flakiest test ever, the scariest phrase a manager can say, and which horror monster test automation really is.

0:00 / 0:00

Join the Guild for (FREE)!

Email New Tab

Exclusive Sponsor

Meet the TestGuild Community in Person

Only three TestGuild IRL events are left in 2026. If you’ve been listening to the podcast and want to connect with testers face to face, this is your chance.

Austin, November 3
Dallas, November 5
Santa Clara, December 10

Each event runs 4:30 PM to 8:30 PM and includes a local expert panel, practical sessions on what’s working in testing right now, a look at the top trends from me, and plenty of time to network with automation engineers and testing leaders in your area.

👉 Grab your spot at testguild.com/irl

About Paul Grossman

Paul Grossman is the Dark Arts Wizard of Agentic Test Automation. He has been a Test Automation Evangelist for 25 years. He has touched every tool including Mercury WinRunner, UFT, Selenium and many paid tools. He uses his TikTok and YouTube channels for side-by-side comparisons of tools with his CandyMapper challenge.

He co-authored “Enhanced Test Automation with WebdriverIO" with Larry Goddard.

Most recently he started supporting a Typescript Playwright called Optimus Prime.

Paul has been Joe Colantonio’s Test Guild guest every Halloween for 10 years. At conferences he always has a live demo and the occasional magic trick.

Paul’s current passion is leveraging Agentic LLMs to implement missing features automation platforms.

Connect with Paul Grossman

• • Company: mcgraw hill
  • LinkedIn: www.pmgrossman
  • Twitter: www.DarkArtsWizard

Rate and Review TestGuild

Thanks again for listening to the show. If it has helped you in any way, shape, or form, please share it using the social media buttons you see on the page. Additionally, reviews for the podcast on iTunes are extremely helpful and greatly appreciated! They do matter in the rankings of the show and I read each and every one of them.