Xamarin, a provider of cross-platform mobile application development solutions, has released the Xamarin Test Cloud, the company's mobile app quality service that enables developers to automatically test their apps throughout the development process.
With the production launch of Xamarin Test Cloud, developers can test how their apps look, perform and behave on more than 1,000 real devices, as mobile users expect apps to look good and function well on every device.
With nearly 19,000 distinct Android devices, according to OpenSignal's latest fragmentation report, and more than a dozen iOS devices, including the new iPhone 6 models, ensuring app quality is a major challenge facing mobile developers.
"The state of mobile testing today is primitive," said Nat Friedman, CEO and co-founder of Xamarin, in a blog post on the news. "Last month we ran a survey that found that nearly 80 percent of mobile developers are relying primarily on manual testing in their attempts to deliver great app experiences. And yet, more than 75 percent told us that the quality of their mobile apps is either 'very important' or 'mission critical.'"
With app automation, mobile testing is performed continuously throughout the development cycle, across hundreds of devices, and results are provided in minutes in an actionable report. By plugging into Continuous Integration (CI) systems, Xamarin Test Cloud helps to ensure every release is a high-quality release, free of regressions and bugs, which can lead to poor app ratings and low adoption.
Xamarin Test Cloud is easily integrated into CI environments to run tests and generate reports with every build. Xamarin Test Cloud works with Microsoft's Team Foundation Server, Jenkins, TeamCity and any other CI system that can run custom post-build commands.
"We believe that testing is not something you should do at the end of the development cycle, just before submitting to the app store," Friedman said. "Instead, your app should be continuously tested during development in an automated, scalable way. Your developers should be writing user interface tests as they develop the app, and commits shouldn't be merged until the tests pass."
"Xamarin Test Cloud helped us identify and fix critical device-specific issues in the latest release of Foursquare before we released," said Mike Singleton, software engineer at Foursquare.
Only 13 percent of respondents in Xamarin's survey said they use automated user interface testing. This gap between high interest in mobile quality and low usage of automation is in large part due to usability issues or lack of good automation support with the current solutions on the market, Xamarin officials said. This gap is why Xamarin invested in Xamarin Test Cloud.
"With Xamarin Test Cloud, you can create your own test scripts using our powerful testing framework, run them locally against emulators or devices, and then press a button to run the same tests on as many devices as you would like in the cloud," Friedman said.