Close
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Applications
    • Applications
    • Networking
    • PC Hardware

    How NVIDIA is Evolving from GPUs to xPUs 

    eWEEK EVENT ANALYSIS: At its GPU Technology Conference, NVIDIA makes significant advancements in CPUs and DPUs.

    By
    Zeus Kerravala
    -
    April 13, 2021
    Share
    Facebook
    Twitter
    Linkedin
      NVIDIA.GTC.conference2020

      This week NVIDIA is holding its digital GPU Technology Conference (GTC). Historically, the event has been focused on developers, gamers, data scientists, auto manufacturers and other industries that have leveraged NVIDIA’s core product, the GPU. During the past few years, the company has made a number of moves, both through acquisitions and internal development, to expand its processor expertise into other types of silicon.

      At GTC 2021, NVIDIA made a few key announcements in this area. These include:

      NVIDIA enters CPU market with Project Grace

      Historically, NVIDIA has been all about GPUs but never disputed the value of a CPU. It did, and rightfully so, point out that Moore’s Law was running out of steam and the performance of CPUs was plateauing. There have been some theories as to how to kickstart Moore’s Law including moving away from silicon itself. At GTC, NVIDIA announced Project Grace, named after Grace Hopper, a pioneer of computer programming in the 1950s. Grace aims to remove many of the limitations on the traditional x86 architecture.

      The benefit of x86 is the ability to server varying configurations of CPU, memory, PCI express and peripherals to serve the needs of applications. However, processing large amounts of data has been and continues to be a problem. This is particularly true for transformers and recommender systems and is a big reason why CPU leader Intel has never cracked the AI market.

      Grace solves the CPU bottlenecks

      During his keynote address on April 13, NVIDIA CEO Jensen Huang gave an example to illustrate the bottleneck with a scenario where a CPU with 3X the memory of a GPU was running 40X slower. Why is that? The answer lies in the architecture where the data being processed by the CPU had to go through the PCI express bus, making it the bottleneck. With GPUs, the NVLink technology, NVIDIA created can process data across multiple GPUs at once.

      This is the concept behind Grace, where the architecture is purpose-built for accelerated computing and the processing of large amounts of data, such as AI. Grace uses ARM processors, which NVIDIA is in the process of acquiring, and NVLink to create much faster CPU performance.

      To be clear, Grace isn’t a replacement for the CPU in one’s PC. It’s a highly specialized processor targeting workloads such as NLP models that have billions–or even trillions–of parameters. NVIDIA claims that when Grace is combined with its GPUs, the system will deliver 10x better performance over the comparable x86 systems. Given NVIDIA’s expertise in building accelerated computing systems, this certainly seems reasonable.

      NVIDA announces BlueField-3 DPU

      Last year, NVIDIA announced its data processing unit, also known as a DPU. For those not familiar with DPUs, a simple way to think about it is that it’s a network interface card (NIC) that has been souped up to offload many of the CPU tasks. By offloading these functions, the CPU on the server can handle more workloads. With traditional systems, the NIC does basic networking things and lets the CPU handle tasks such as security, software-defined storage and other tasks.

      Last October, NVIDIA announced its BlueField-2 and 2X DPUs. This week, the company unveiled the first DPU designed for AI and accelerated computing, the BlueField-3. The card is optimized for multi-tenant, cloud-native environments and offers software-defined, hardware-accelerated networking, storage, security and management capabilities at data center speeds. A single BlueField-3 has the processing capabilities of 300 CPU cores, freeing up precious CPU cycles on the servers.

      The new DPU will have 16 ARM A78 cores, providing 400 Gbit/sec of bandwidth. It will also include hardware accelerators for storage, networking, cybersecurity, streaming, line-rate encryption and precision-timing 5G telco environments. As a point of comparison, the BlueField-2 contains 8 Arm A72 cores and offers 200 Gbit/sec of performance.

      NVIDIA success comes from hardware and software innovation

      As is the case with most things NVIDIA, the hardware isn’t the whole story. NVIDIA’s DOCA software development kit lets developers created DPU accelerated services using standardized APIs. It’s the combination. It’s this combination of hardware and software that has enabled NVIDIA to go roaring by rival Intel and stretch its lead.

      BlueField already has a large ecosystem that includes Dell Technologies, Inspur, Lenovo and Supermicro, who are integrating BlueField into their systems. Cloud providers Baudu, JD.com and UCloud also announced they would be using the DPUs. Also, security vendors Fortinet and Guardicore announced support, as did edge systems vendors Cloudflare, Juniper and F5.

      For those wondering when we might see BlueField-4, Huang indicated it would be announced in the 2024 time frame.

      NVIDIA grew up and came to prominence as a GPU provider, but that’s just a part of what the company does. Its silicon expertise has now been extended to DPUs and CPUs, and the combination of the three will drive innovation faster than ever before.

      Huang summed up the possibilities when he ended his keynote with the following statement: “Twenty years ago, all of this was science fiction. Ten years ago, it was a dream. Today, we are living it.”

      Zeus Kerravala
      https://zkresearch.com/
      Zeus Kerravala is an eWEEK regular contributor and the founder and principal analyst with ZK Research. He spent 10 years at Yankee Group and prior to that held a number of corporate IT positions. Kerravala is considered one of the top 10 IT analysts in the world by Apollo Research, which evaluated 3,960 technology analysts and their individual press coverage metrics.

      MOST POPULAR ARTICLES

      Cybersecurity

      Visa’s Michael Jabbara on Cybersecurity and Digital...

      James Maguire - May 17, 2022 0
      I spoke with Michael Jabbara, VP and Global Head of Fraud Services at Visa, about the cybersecurity technology used to ensure the safe transfer...
      Read more
      Cloud

      Yotascale CEO Asim Razzaq on Controlling Multicloud...

      James Maguire - May 5, 2022 0
      Asim Razzaq, CEO of Yotascale, provides guidance on understanding—and containing—the complex cost structure of multicloud computing. Among the topics we covered:  As you survey the...
      Read more
      IT Management

      Intuit’s Nhung Ho on AI for the...

      James Maguire - May 13, 2022 0
      I spoke with Nhung Ho, Vice President of AI at Intuit, about adoption of AI in the small and medium-sized business market, and how...
      Read more
      Big Data and Analytics

      GoodData CEO Roman Stanek on Business Intelligence...

      James Maguire - May 4, 2022 0
      I spoke with Roman Stanek, CEO of GoodData, about business intelligence, data as a service, and the frustration that many executives have with data...
      Read more
      Applications

      Cisco’s Thimaya Subaiya on Customer Experience in...

      James Maguire - May 10, 2022 0
      I spoke with Thimaya Subaiya, SVP and GM of Global Customer Experience at Cisco, about the factors that create good customer experience – and...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2021 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×