AI Generate Missing Playwright Tests, Postman AI, CY-prompt and more TGNS160

tgnJune8ep160.mp3

[00:00:00] Joe Colantonio How can you generate missing tests automatically with Playwright? Have you seen the posts on Automating Postman API responses using AI? And what is the new feature that Cypress just released? Find out all about it in this episode of the Test Guild News Show for the week of June 8. So grab your favorite cup of coffee or tea and let's do this.

[00:00:19] Joe Colantonio Hey, before we get into the news, I want to thank this week's sponsor, Zaptest AI, an AI driven platform that can help you supercharge your automation efforts. It's really cool because their intelligent co-pilot generates optimized code snippets, while their planned studio can help you effortlessly streamline your test case management. And what's even better is you can experience the power of AI in action with their risk-free 6 month proof of concept featuring a dedicated ZAP expert at no upfront cost. Unlock unparallel efficiency and ROI in your testing process. Don't wait. Schedule your demo now and see how it can help you improve your test automation efforts using the link down below.

[00:00:58] Joe Colantonio Our first up is all about Playwright and this by Debbie O'Brien, who announced on LinkedIn how she just published a walkthrough demonstrating how testers can use the Playwright MCP server in tandem with AI based prompting to automatically generate missing end-to-end tests. And the video highlights how rather than relying on predefined assumptions, the MCP server interacts with the application in real time to identify untested paths. AI then reviews the current test coverage. And the video highlights the process, which includes the automated detection of test gaps by simulating user behavior, prompt based directives for generating Playwright code aligned with best practices, test maintenance suggestions like identifying duplicate tests or redundant navigation checks and a whole bunch more. And also Debbie also emphasized the importance of crafting a detailed prompt file and using human oversight to refine AI outputs. Definitely seems like a really cool use of AI and Playwright and MCP server. And you can watch the whole video for yourself using the special link down below.

[00:02:03] Joe Colantonio Next up is the webinar of the week. So here at The Test Guild, we're running a joint webinar with BlinkIO, all about how QA leaders and banking can use GenAI for testing without compromising security, compliance, or stability. This webinar happening this Wednesday is aimed at QA Leaders in the financial sector, focusing on the strategic use of GenerativeAI and software testing. And the session is going to explore how banking organizations can adopt GenAI powered testing solutions while maintaining strict security protocols, regulatory compliance, and operational stability. And the webinar is going to address concerns specific to highly regulated industries where the adoption of AI can raise red flags around data governance, model explainability, the risk of unauthorized behavior by AI systems. And as always, Blink.io is going to share some real world case studies and provide practical guidance on aligning AI based testing with enterprise risk frameworks. So make sure to register even if you can't make the event, make sure to register because everyone that registers is going to receive a recording of the session in a few days after the webinar is over. And you can register now using that special link down below.

[00:03:14] Joe Colantonio All right. Do you do anything with Kafka? If so, here's a great announcement. This was announced on Kanika's LinkedIn profile, how Loadmill has just open source their Kafka Relay client and released it on GitHub. And what's really cool is this tool addresses the growing demand for more sophisticated event driven architectures among software testers by allowing testers to simulate Kafka message streams effortlessly. So Kafka, widely used for real time data pipelines and streaming applications, now has a new companion and the LoadMill Kafka Relay, which simplifies the generation and control of test traffic across distributed systems. It provides a set of APIs to interact with the Kafka brokers, manage message production, consumption, and schema registry operations. And it was built to help you test your Kafka infrastructure and applications, and to make it easier to debug and troubleshoot Kafka related issues.

[00:04:09] Joe Colantonio Also, on LinkedIn, I came across this post by Roberto, who announced that Cypress has announced early access to a new feature called Cyprompt. They describe it as the easiest way to write and maintain Cypress test using AI plus natural language prompts. And they also claim that this new feature allows you to write Cypress test 10x faster with their AI powered prompts and also CI prompt adopts to your app changes, reducing false failures and keeping tests stable. And the early access program for Cyprompt is currently open for testers seeking to integrate this feature into their workflows. And they have a link where you can register for it as well for the early access. Check it out. Let me know your thoughts.

[00:04:50] Joe Colantonio I also found another really cool use of AI on LinkedIn. It was a post by Dylan, who just announced a new medium post that he created that details how testers can streamline API response comparisons by utilizing Postman along with the plugging face AI. This post goes over the technique leveraging Postman's robust API testing capabilities combined with machine learning models from Hugging Face to automate the process of evaluating API responses and the integration aims to improve efficiency and accuracy in validating API data, addressing a common challenge in software testing, and it outlines a method that testers can follow to employ Hugging Faces advanced natural language processing models to assess semantic equivalence in API responses. And this approach provides a sophisticated layer of analysis that goes beyond simple data matching, allowing for more nuanced comparisons.

[00:05:45] Joe Colantonio What's the Cypress Schema Validator plugin? Well, let's find out. This is by Sebastian, a frequent contributor on the News Show that he just released the Cypress Schema Validater plugin that brings several functional upgrades, the Schema validation and Cypress based test automation. And this plugin is the successor to the previously known Cypress AJV Schema Validator, now offering support for both AJV and ZOD validators. Among it, notable features are terminally friendly error messages, customizable styling for validation feedback, and unifying error format designed to simplify debugging and testing reports. This tool maintains full backward capabilities for earlier versions and allows teams to upgrade without reworking existing tests.

[00:06:31] Joe Colantonio Have you seen the latest Dora report? If not, this is something you definitely should check out. This recent publication from the DevOps Research and Assessment Dora team reveals critical insights into the impact of continuous delivery practices on software development performance. And the research based on survey data from thousands of developers find that while AI adoption increases individual productivity by approximately 2.1% or 25% increase in usage, it simultaneously reduces Software delivery stability by 7.2% and throughput by 1.5%. And the study suggests that this paradox stems from developers creating large code changes when using AI tools, violating established principles of small batch development. And it goes over the study found that only 61% of developers actually trust AI generated code quality with trust levels directly correlating to productivity gains. And I think this just highlights what a lot of testers have been saying all along with all this code being generating, it's becoming more and more and more code. What do you need to do? You need to test it. So testers should prepare for potentially larger, more complex code changes that are going to require enhanced verification processes.

[00:07:42] Joe Colantonio Do I know more about synthetic monitoring? Well, this next post talks about how to optimize your end user experience and how to perform a browser check in Grafana Cloud's synthetic monitoring. Grafana just made this recent enhancement to optimize end user experience through improved browser testing capabilities. And this enhancement enables developers and software testers to conduct browser checks directly via Grafana Cloud, allowing you basically to simulate real user interactions and monitor the performance and help of a web application more effectively. And this feature supports multiple browser types, provides extensive coverage for testing conditions and integrates seamlessly with existing Grafana monitoring tools, but then enables you to give more comprehensive performance analysis alongside other system metrics.

[00:08:31] All right. Last up is security news and Srini and Sai have done it again. They just released another new open source tool. This one is called Secure-Hulk, which is aimed to help DevSecOps teams detect and mitigate security vulnerabilities in their MCP servers and tools. Secure-Hulk is designed to scan for several highly risked threats commonly associated with AI driven systems, including prompt ejection and tool poisoning, data exfiltration and privilege escalation, and toxic agent behavior flows and cross origin attacks.

[00:09:04] All right. And for links of everything of value we covered in this news episode, head on over to the links in the comment down below. That's it for this episode of the Test Guild News Show. I'm Joe, my mission is to help you succeed in creating end-to-end full stack pipeline automation awesomeness and as always test everything and keep the good. Cheers.