Close
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Applications
    • Applications
    • Cloud

    IBM, Mellanox, Tencent Team Breaks Sorting Speed Records

    By
    Chris Preimesberger
    -
    November 11, 2016
    Share
    Facebook
    Twitter
    Linkedin

      Speed, especially in NASCAR and IT events, makes news. On Nov. 10, server-maker IBM, high-performance networking provider Mellanox and China-based Tencent Cloud made their own IT speed news when a cloud solution they put together was named winner of the Sort Benchmark annual global computing competition for 2016.

      Tencent Cloud and the Big Data Collaboration team spent less than 99 seconds (98.8 seconds) finishing sorting 100 terabytes of data in the Indy GraySort category, improving upon 2015’s best result—329 seconds—by a factor of 3.3.
      Each year, global companies and academic institutions participate in the contest, conducted by non-profit Sortbenchmark.org, to evaluate the capability of their software and hardware system architectures, as well as their research results.

      Tencent Cloud participated in two of the four competition categories, GraySort and MinuteSort, to benchmark the architecture capabilities and computing efficiencies of large distributed computing systems and real time data analytics. The GraySort and MinuteSort benchmarks are each measured in two subcategories: Indy (special purpose sort) and Daytona (general purpose sort).

      Dominant in Each Category

      Tencent Cloud Data Intelligence—the distributed computing platform of Tencent Cloud—won each category in both the GraySort and MinuteSort benchmarks, establishing four new records with its performance, outperforming 2015’s best speeds by two to five times.

      “In the future, the ability to manage big data will be the foundation of successful internet businesses,” said Zeus Jiang, Vice President of Tencent Cloud and General Manager of Tencent’s Data Platform Department. “Tencent Cloud can provide precise high-performance computing to enterprises using minimal time and resources. We will continue to improve the back-end technology for our cloud service by optimizing architecture, software and hardware to help global enterprises solve complex business challenges by leveraging hyper-scale computing platforms.”

      As a non-profit organization, Sortbenchmark.org uses the basic sort computing method to evaluate distributed system software architectural capabilities such as storage, task scheduling, node communication and data exchange. It also evaluates hardware architectural capabilities, including server selection and match, network architecture optimization, and the ability to build Internet Data Centers.

      Solution Used IBM POWER Servers, Mellanox 100Gb Connectivity

      The ultimate test is on the comprehensive capabilities of large-scale computing of a company or an organization. In this sort contest, Tencent Cloud used 512 IBM OpenPOWER servers and Mellanox’ 100Gb interconnect technology, improving the performance of Tencent Cloud big data products with the infrastructure.

      “Tencent is helping IBM and our OpenPOWER partners push performance boundaries for a cognitive era defined by big data and advanced analytics,” said Tom Rosamilia, Senior Vice President of IBM Systems. “The computing record achieved by Tencent Cloud on OpenPOWER is an important milestone for the industry.”

      Real time-analytics and big data environments are extremely demanding and the network is critical in linking together the extra high performance IBM POWER based servers and Tencent Cloud’s massive amounts of data, said Amir Prescher, SeniorVice President, Business Development, at Mellanox Technologies.

      “Tencent Cloud developed an optimized hardware/software platform to achieve new computing records, showing that Mellanox’s 100Gb/s Ethernet technology can deliver total infrastructure efficiency and improves application performance, making them ideal for Big Data applications,” Prescher said.

      2016 Sort Benchmark Contest Results (improvement)

      Daytona GraySort: 44.8 TB/min (old record: 15.9 TB/min; 2.8X greater performance)
      Indy GraySort: 60.7 TB/min (old record: 18.2 TB/min; 3.3X greater performance)
      Daytona MinuteSort: 37 TB/min (old record: 7.7 TB/min; 4.8X greater performance)
      Indy MinuteSort: 55 TB/min (old record: 11 TB/min; 5X greater performance)

      Chris Preimesberger
      https://www.eweek.com/author/cpreimesberger/
      Chris J. Preimesberger is Editor Emeritus of eWEEK. In his 16 years and more than 5,000 articles at eWEEK, he distinguished himself in reporting and analysis of the business use of new-gen IT in a variety of sectors, including cloud computing, data center systems, storage, edge systems, security and others. In February 2017 and September 2018, Chris was named among the 250 most influential business journalists in the world (https://richtopia.com/inspirational-people/top-250-business-journalists/) by Richtopia, a UK research firm that used analytics to compile the ranking. He has won several national and regional awards for his work, including a 2011 Folio Award for a profile (https://www.eweek.com/cloud/marc-benioff-trend-seer-and-business-socialist/) of Salesforce founder/CEO Marc Benioff--the only time he has entered the competition. Previously, Chris was a founding editor of both IT Manager's Journal and DevX.com and was managing editor of Software Development magazine. He has been a stringer for the Associated Press since 1983 and resides in Silicon Valley.

      MOST POPULAR ARTICLES

      Cybersecurity

      Visa’s Michael Jabbara on Cybersecurity and Digital...

      James Maguire - May 17, 2022 0
      I spoke with Michael Jabbara, VP and Global Head of Fraud Services at Visa, about the cybersecurity technology used to ensure the safe transfer...
      Read more
      Big Data and Analytics

      Alteryx’s Suresh Vittal on the Democratization of...

      James Maguire - May 31, 2022 0
      I spoke with Suresh Vittal, Chief Product Officer at Alteryx, about the industry mega-shift toward making data analytics tools accessible to a company’s complete...
      Read more
      Big Data and Analytics

      GoodData CEO Roman Stanek on Business Intelligence...

      James Maguire - May 4, 2022 0
      I spoke with Roman Stanek, CEO of GoodData, about business intelligence, data as a service, and the frustration that many executives have with data...
      Read more
      Applications

      Cisco’s Thimaya Subaiya on Customer Experience in...

      James Maguire - May 10, 2022 0
      I spoke with Thimaya Subaiya, SVP and GM of Global Customer Experience at Cisco, about the factors that create good customer experience – and...
      Read more
      Cloud

      Yotascale CEO Asim Razzaq on Controlling Multicloud...

      James Maguire - May 5, 2022 0
      Asim Razzaq, CEO of Yotascale, provides guidance on understanding—and containing—the complex cost structure of multicloud computing. Among the topics we covered:  As you survey the...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2021 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×