Close
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Cloud
    • Cloud
    • Development

    Google Releases Tools for Comparing Cloud Performance Across Vendors

    By
    Jaikumar Vijayan
    -
    February 12, 2015
    Share
    Facebook
    Twitter
    Linkedin
      cloud dashboard

      Google has released a new open-source toolset for developers struggling to measure the relative performance of the Google Cloud Platform against cloud offerings from other vendors.

      The company’s new PerfKit Benchmarker offers what Google claims is a way for organizations to do an apples-to-apples comparison of application performance on cloud platforms from different service providers.

      It allows companies to compare metrics like application throughput, performance variances, latency and overhead, and the time it takes for an organization to provision resources in the cloud. The benchmarking framework is based on input from other cloud providers, analysts and cloud performance experts in academia, Google said in a blog post Feb. 11.

      Among the more than 30 organizations that contributed to the effort are Cisco, Rackspace, Broadcom, Canonical, Red Hat and CloudHarmony. In addition, researchers from MIT and Stanford University will contribute to the ongoing effort to keep the benchmarks updated and relevant.

      “PerfKit is unique because it measures the end to end time to provision resources in the cloud, in addition to reporting on the most standard metrics of peak performance,” Google said.

      According to an official description, PerfKit Benchmarker is designed to operate via vendor-provided command-line tools. “It instantiates VMs on the Cloud provider of your choice, automatically installs benchmarks, and runs the workloads without user interaction,” according to the description.

      Google will constantly update the benchmarks to make sure they measure the latest workloads so organizations can make more informed decisions about their infrastructure requirements, the company noted in its blog.

      “We’ll adapt PerfKit to keep it current,” Google noted. “It already includes several well-known benchmarks, and covers common cloud workloads that can be executed across multiple cloud providers.”

      In addition to the benchmarking toolkits, Google has released a new dashboarding and performance analysis tool called PerfKit Explorer to help developers interpret benchmark results. The data visualization tool comes with a set of dashboards prepopulated with data from internal network performance tests from Google to allow developers to get used to it without having to input any of their own data first.

      Google has made the source code for PerfKit Benchmarker and PerfKit Explorer available under open-source Apache 2 licensing terms.

      The new benchmarking tools represent an effort by Google to help make cloud performance comparison easier. The rapid growth of infrastructure-as-a-service (IaaS) and platform-as-a-service (PaaS) cloud services in recent years and the different metrics used by providers of these services to tout application performance have made it hard for companies to do straightforward comparisons of different cloud services.

      According to a Google spokeswoman, the new tools will specifically allow organizations to compare virtual machines (VMs) and object storage across clouds and physical hardware. The company plans to expand it to include more IaaS, PaaS and software as a service (SaaS) services in the future.

      “It automates a number of workloads like Cassandra, Aerospike, Hadoop, SpecCPU and micro-benchmarks like iperf and netperf,” she said.

      CloudHarmony, one of the companies that contributed to Google’s PerfKit, highlighted some of these difficulties in a blog post last year. “Because of the diverse deployment options and dissimilar features of different services, formulating relevant and fair comparisons is challenging to say the least,” Cloudharmony founder Jason Read wrote. “In fact, we’ve come to the conclusion that there is no perfect way to do it.”

      Among the challenges that Read highlighted in his report is the difficulty in finding virtual machine instances and services that are truly comparable across the different vendors, finding appropriate workloads for testing and using the right benchmarks.

      “With a lack of standardization in the IaaS industry, providers freely use unique terminology to describe their VM resource allocations,” Cloud Spectator previously noted after performing cloud performance testing. “As the market quickly saturates with IaaS providers, the decision-making complexity of choosing the right provider evolves as well.”

      Jaikumar Vijayan
      Vijayan is an award-winning independent journalist and tech content creation specialist covering data security and privacy, business intelligence, big data and data analytics.

      MOST POPULAR ARTICLES

      Big Data and Analytics

      Alteryx’s Suresh Vittal on the Democratization of...

      James Maguire - May 31, 2022 0
      I spoke with Suresh Vittal, Chief Product Officer at Alteryx, about the industry mega-shift toward making data analytics tools accessible to a company’s complete...
      Read more
      Cybersecurity

      Visa’s Michael Jabbara on Cybersecurity and Digital...

      James Maguire - May 17, 2022 0
      I spoke with Michael Jabbara, VP and Global Head of Fraud Services at Visa, about the cybersecurity technology used to ensure the safe transfer...
      Read more
      Applications

      Cisco’s Thimaya Subaiya on Customer Experience in...

      James Maguire - May 10, 2022 0
      I spoke with Thimaya Subaiya, SVP and GM of Global Customer Experience at Cisco, about the factors that create good customer experience – and...
      Read more
      Cloud

      IGEL CEO Jed Ayres on Edge and...

      James Maguire - June 14, 2022 0
      I spoke with Jed Ayres, CEO of IGEL, about the endpoint sector, and an open source OS for the cloud; we also spoke about...
      Read more
      Big Data and Analytics

      GoodData CEO Roman Stanek on Business Intelligence...

      James Maguire - May 4, 2022 0
      I spoke with Roman Stanek, CEO of GoodData, about business intelligence, data as a service, and the frustration that many executives have with data...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2022 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×