AI Performance Testing: How to Scale Agentic AI with Kandasamy Selvaraj
with Kandasamy Selvaraj
Key takeaways
What you'll learn in this episode
Shifts performance gates left into every commit with JMeter
Shifts right with synthetic monitors on blue green deployments
Uses Langfuse and OpenTelemetry to spot context bloat before it hits production.
About this episode
Everything you knew about performance testing changes when the system you're testing is non deterministic.
In this episode of the TestGuild Automation Podcast, Joe Colantonio sits down with Kandasamy Selvaraj, Principal Architect and author of the free book Rethinking Performance Engineering for Agentic AI, to unpack what it really takes to move an AI agent from a working demo to an enterprise system handling millions of conversations per hour.
Checkout his free book: https://leanpub.com/agentic-ai-performance
Kandasamy shares the practical playbook he's built running agentic AI in production, including why the same request can take three seconds one run and eight seconds the next, how to use harnesses to bound tool calls, reasoning loops, and token budgets, and why your SRE dashboard can look perfectly healthy while your token costs quietly balloon to five times baseline.
You'll learn how his team:
You'll also hear how to:
- Slash AI costs with prompt caching
- Conversation capping
- Routing simple queries to cheaper models
- Why you should load test at the API layer before touching the UI,
- How to keep stubs honest with production sampled latency
- Why one misbehaving agent can starve every other agent sharing the same provider.
If you're a tester, performance engineer, SRE, or architect building on LLMs, this conversation will change how you think about scale.
Kandasamy has built a distinguished career translating performance insight into measurable business outcomes. He championed shift-left performance practices and automated performance gates in CI/CD pipelines, reducing production defects by 80% and accelerating deployments by 40%.
His multi-tier optimization work, spanning JVM tuning, database optimization, async messaging, and infrastructure right-sizing,delivered 75% latency reductions while supporting millions of concurrent users. Among his standout achievements is a cluster-enabled caching framework that achieved 85% cache-hit rates and drove 50x throughput gains. He has led multiple large-scale performance initiatives, including engineering Super Bowl–scale event infrastructure from the ground up,stress-testing systems to 10x target throughput and validating resilience for over one million concurrent users, all with zero downtime on game day.
He also conducted real-time, in-flight performance engineering for GOGO Wi-Fi across U.S. commercial airlines, running production load tests above 10,000 feet to tune ATG signal performance (forward and reverse ATG links) and ensure scalable wireless delivery in the air. His broader portfolio spans high-impact performance and scalability engineering across insurance, retail, financial services, healthcare, and airline connectivity industries.
A strong advocate for observability, Kandasamy implemented enterprise APM tooling using a monitoring-as-code approach and deployed chaos engineering practices that achieved 99.99% platform availability. He holds an AWS Certified Solutions Architect credential, a Certified Chaos Engineering Practitioner certification, an APM Associate Certification, a Generative AI Certified Professional credential, and a Post Graduate Program in Artificial Intelligence and Machine Learning.
Keep listening
Related episodes

Automation Testing Podcast · Ep. 610
How to Prove Your Release Is Ready When AI Writes the Code
How to Prove Your Release Is Ready When AI Writes the Code? Can you prove your software is ready to ship, or does that answer still depend on a meeting and a spreadsheet? Want to see if your team can prove a release is ready? Book a custom LoopIQ demo with Ashwin: https://testgld.link/loopiqdemo In this episode,
Nov 3

Automation Testing Podcast · Ep. 609
Why Your AI Tests Pass When Your Features Fail with Donovan Brady
with Donovan Brady
Why Your AI Tests Pass When Your Features Fail? Donovan Brady of Leapwork shows how to make
Oct 27

Automation Testing Podcast · Ep. 608
Scary Test Automation POCs Made Easy: Halloween Special With Paul Grossman
with Paul Grossman
Running a proof of concept on test automation tools can feel like a horror movie. Vendors promise
Oct 20

Automation Testing Podcast · Ep. 607
Locust and Azure Load Testing: Create and Debug Load Tests with AI with Lars Holmberg and Abhinav Premsekhar
with Lars Holmberg and Abhinav Premsekhar
Performance testing has never been easier to start, or more important to get right. As teams ship
Oct 6