How Sauce Labs Analytics Accelerates Software Testing

New features support DevOps initiatives by providing near real-time, multi-dimensional analysis of tests, enabling teams to release software faster.


Sauce Labs, whose cloud-based development platform automates testing of web and mobile applications, has added a new analytics feature that is available at no charge to all of its customers.

Sauce Labs Test Analytics, introduced June 1, becomes the latest addition to the Sauce Labs Automated Testing Cloud. This latest release provides users with near real-time, multi-dimensional test analytics to optimize resources and release software faster.

Speed is what all software development is all about, and testing to make this happen is certainly what this company is all about.  Ken Drachnik, the company’s director of product marketing, told eWEEK that the company’s customers do anywhere from 1 million to 2 million tests per day in its cloud.

“We just passed our 1 billionth test—billionth with a ‘B.’ That’s an awful lot of tests we’ve run since our inception in 2008,” Drachnik said.

Selenium, Appium Testing

Sauce Labs claims to be the world’s largest test cloud for Selenium and Appium (Selenium is for web and mobile devices) tests, Drachnik said. Appium is an open source test automation framework for use with native, hybrid and mobile web apps. It drives iOS, Android and Windows apps using the WebDriver protocol.

With development teams often distributed across the globe, it is difficult to obtain insights into testing behaviors and patterns in a way that make sense, said Sauce Labs Vice-President of Products Lubos Parobek.

“Sauce Labs Test Analytics addresses this need by providing users the insights to optimize their tests, release software faster and drive CI/CD and DevOps initiatives forward,” Parobek said.

Sauce Labs Test Analytics brings analytics not only to software developers but to anyone in an enterprise, including executives, developers, test engineers and QA teams. The platform allows users to dig deep into test results to identify important trends, Drachnik said.

Executives can use a high-level dashboard to get an overview of test coverage, feature readiness and releases, while more technical users can drill down into individual tests to identify common failures.

List of Key Business Benefits

Key benefits of Sauce Labs Test Analytics include:

  • Quick analysis of data: Features an interactive drag-and-drop user interface, providing visualization of test metrics such as number of tests, pass/fail and error rates, and more. Users can identify trends and make changes to code or practices to increase pass rates and speed code releases. 
  • Easy access to build and test statistics: Empowers users to dig deeper into builds and test failures. By knowing the underlying cause of test failures in aggregate, steps can be taken to resolve problems that impact the most number of tests, speeding up the overall process. 
  • Ability to identify errors with the help of multidimensional filters: Provides quick insight into success/failure rates by build, platform, browser, department or user. Users can drill down to specific test problem areas, with a five second granularity, to identify the root cause of systemic testing errors, and compare app stability on the latest platforms.
  • Optimize tests to maximize efficiency: Lets users view the level of parallelization of their tests along with concurrency usage.  By optimizing tests run in parallel, you can execute more test cases, faster and use your Sauce concurrency more efficiently.
  • REST API: Analytics test trend data is also available for consumption via Sauce Labs’ REST APIs. Users can aggregate analytics data into their home-grown dashboard or test analytics tools, providing a unified view of test data. 

Sauce Labs is optimized for continuous integration and continuous delivery workflows. When tests are automated and run in parallel on virtual machines or real devices, testing time is significantly reduced and IT teams no longer need to devote time to managing testing infrastructure, Drachnik said.

When paired with a CI system, multiple development teams can instantly provision scalable resources to test web, hybrid, and native applications, continuously and affordably. Sauce Labs currently supports more than 800 browser, operating system, and device combinations, Drachnik said.

Sauce Labs is privately held and funded by Toba Capital, Salesforce Ventures, Centerview Capital Technology, IVP and Adams Street Partners.

Sauce Labs Test Analytics is currently available at no charge to all Sauce customers. For more details, go here

You can register for a free trial of Sauce Labs here.

Chris Preimesberger

Chris J. Preimesberger

Chris J. Preimesberger is Editor-in-Chief of eWEEK and responsible for all the publication's coverage. In his 15 years and more than 4,000 articles at eWEEK, he has distinguished himself in reporting...