In this episode, we Test Talk with Lubos Parobek all about the brand new feature recently announce by Sauce Labs –Test Analytics. Test Analytics is the latest addition to the Sauce Labs Automated Testing Cloud. Whats awesome about the Test Analytics feature is that it will help you to reduces the time spent on analyzing test results by providing users trends on key metrics so that they can track down failures faster! So listen up and discover how to speed up your test automation debugging efforts.
163: Sauce Labs Test Analytics with Lubos Parobek
with Lubos Parobek
About this episode
Quotes & Insights from this Test Talk
- So yeah we're very excited at the conference to introduce Sauce analytics and it provides insights that allow our customers to optimize their testing for both higher speed and quality. The initial release which came out just a few weeks ago at the conference includes a few real time measures and we'll be adding to these over time. But the initial real time measures include the quantity of test pass fail trend's error rates and even test efficiencies statistics. All of these measures can be sliced and diced with a variety of multi dimensional filters. Those filters include operating system browser the time frames so you can select anywhere from 30 days to you know down to a minute. As well as by different teams or individuals that are running the tests. We also made it really easy to test analytics to drill down through these numbers so that you can actually identify that the specific build or test information that might be the root cause of a negative trend.
- We've had lots of discussions and surveys and there were some little some real common themes, common questions that people were asking you know one was you know “hey is my quality satisfactory on you know all the relevant platforms I want to support you know the key browsers are trying to support the theory that the mobile devices are trying to support?" Another question that came up a lot was basically “hey are there particular problems in my infrastructure, particular errors that are popping up that are causing bottlenecks or causing the test to fail?" Another one was “he helped me understand am I actually running my test in parallel or you know am I getting you know the efficiency that I that I should be getting in terms of my Sauce Labs subscription?" You know then there was much more kind of tactical questions just like hey you know what's the root cause of the high failure rate on a safari. You know and then also just very big picture questions like hey my is my build ready to ship or not.
- So there's a couple of different ways to do that so one is that we make it really easy to kind of use these filters to kind of compare you know different operating systems you know different browsers different devices against each other so you can kind of quickly you know kind of toggle things toggle your filters and see if your getting the amount of testing that you expect on each platform and then you know are the test passing to you or to your satisfaction.
- We do think that customers of all sizes will benefit but we think that you know certain customers will customers at a certain size will value certain aspects and others will value other aspects. You know our largest customers run and have teams of the hundreds of teams you know are many hundreds of thousands of tests. And what we see when we talk to these customers around analytics is they really want to see trends across teams across apps that might be slowing testing or causing you know quality issues. And you know often benefit by having this kind of wide lens to identify these common bottlenecks for the organization.
- We definitely believe that the use of known pattern matching and different AI technologies can be really powerful within testing. You know we're at Sauce Labs running over a million and a half tests a day at this point. So we have a kind of a treasure trove of data that we can use to help your customers become better testers.
- Yeah absolutely. So we actually have an idea portal and so super easy to get to just go to https://saucelabs.ideas and you should be able to submit your ideas there.
Resources
Connect with Lubos
- Email:LUBOS [@] saucelabs .com
- Company: SauceLabs
May I Ask You For a Favor?
Thanks again for listening to the show. If it has helped you in any way, shape or form, please share it using the social media buttons you see on the page.
Additionally, reviews for the podcast on iTunes are extremely helpful and greatly appreciated! They do matter in the rankings of the show and I read each and every one of them.

Test Talks is sponsored by the fantastic folks at Sauce Labs. Try it for free today!
Keep listening
Related episodes

Automation Testing Podcast · Ep. 612
Robot Framework Test Automation: Automate Web, Desktop, Mobile, and Embedded Systems
What makes Robot Framework flexible enough to test medical devices, low code bots, monitoring systems, and embedded
Nov 17

Automation Testing Podcast · Ep. 611
Playwright at Scale: Run 500 Tests in Minutes with Oliver Stenbom
with Oliver Stenbom
Is your Playwright suite slowing you down instead of speeding you up? In this episode, Oliver Stenbom,
Nov 10

Automation Testing Podcast · Ep. 610
How to Prove Your Release Is Ready When AI Writes the Code
How to Prove Your Release Is Ready When AI Writes the Code? Can you prove your software is ready to ship, or does that answer still depend on a meeting and a spreadsheet? Want to see if your team can prove a release is ready? Book a custom LoopIQ demo with Ashwin: https://testgld.link/loopiqdemo In this episode,
Nov 3

Automation Testing Podcast · Ep. 609
Why Your AI Tests Pass When Your Features Fail with Donovan Brady
with Donovan Brady
Why Your AI Tests Pass When Your Features Fail? Donovan Brady of Leapwork shows how to make
Oct 27