Close
  • Latest News
  • Artificial Intelligence
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Artificial Intelligence
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Latest News
    • Servers

    Google Gives Glimpse Inside Its Massive Data Center Network

    By
    Jaikumar Vijayan
    -
    June 19, 2015
    Share
    Facebook
    Twitter
    Linkedin
      Google

      Anyone wondering just how much network capacity it takes for Google to deliver all of its myriad services might want to consider this: The company’s current-generation data center networks deliver enough bandwidth to read the entire scanned contents of the Library of Congress in less than one-tenth of one second.

      Amin Vahdat, a Google Fellow and technical lead for networking, provided a rare glimpse inside the company’s data center networks in a blog post coinciding with the Open Network Summit earlier this week.

      According to Vahdat, Google’s current data center network fabric, dubbed Jupiter, can deliver more than 1 petabit per second of total bisection bandwidth, or enough capacity for 100,000 servers to exchange information at 10 gigabits per second per server.

      Jupiter is the result of about 10 years’ worth of effort building in-house network hardware and software for linking Google’s data centers and powering the company’s distributed computing and storage systems, Vahdat said. “When Google was getting started, no one made a data center network that could meet our distributed computing requirements,” he explained. From the beginning, the company has realized that computing infrastructures such as Google File System, MapReduce, Bigtable and Borg require a networking capability not available from others, he said.

      Over the years, Google has gone through five generations of in-house network technology. Between Firehose, Google’s first in-house data center network, and the current-generation Jupiter network, the company has increased capacity more than 100-fold, Vahdat claimed.

      Google’s networks are based on three key principles. All of its networks use a configuration called the Clos topology, where a collection of relatively small and inexpensive switches are arranged in such a manner as to provide the functionality of a much larger logical switch, he said.

      The company then uses a centralized management control software stack to manage the thousands of switches within its data centers, making them effectively act as one large network fabric. Google’s third core principle is it builds its own software and hardware using components from vendors. It has relied more on custom network protocols tailored specifically for its data centers rather than on standard Internet protocols.

      “Taken together, our network control stack has more in common with Google’s distributed computing architectures than traditional router-centric Internet protocols,” Vahdat said. “Some might even say that we’ve been deploying and enjoying the benefits of software-defined networking at Google for a decade.” The architectures for Google’s massive B4 wide area network and its Andromeda network virtualization stack are based on Google’s early work with data center networking, he said.

      Google’s approach to networking has changed the organization of Google’s data, control and management layers, according to Vahdat. The approach has not been without its challenges, however, and Google has had to deploy and redeploy multiple generations of its network technology before getting it right.

      Google’s data center networks are highly modular and constantly upgraded to meet the “insatiable bandwidth demands” of the company’s latest-generation servers, Vahdat said. They are managed to ensure near continuous availability and reliability to meet internal performance demands.

      “Building great data center networks is not just about building great hardware and software. It’s about partnering with the world’s best network engineering and operations team from day one,” he noted.

      Jaikumar Vijayan
      Vijayan is an award-winning independent journalist and tech content creation specialist covering data security and privacy, business intelligence, big data and data analytics.
      Get the Free Newsletter!
      Subscribe to Daily Tech Insider for top news, trends & analysis
      This email address is invalid.
      Get the Free Newsletter!
      Subscribe to Daily Tech Insider for top news, trends & analysis
      This email address is invalid.

      MOST POPULAR ARTICLES

      Latest News

      Zeus Kerravala on Networking: Multicloud, 5G, and...

      James Maguire - December 16, 2022 0
      I spoke with Zeus Kerravala, industry analyst at ZK Research, about the rapid changes in enterprise networking, as tech advances and digital transformation prompt...
      Read more
      Applications

      Datadog President Amit Agarwal on Trends in...

      James Maguire - November 11, 2022 0
      I spoke with Amit Agarwal, President of Datadog, about infrastructure observability, from current trends to key challenges to the future of this rapidly growing...
      Read more
      Cloud

      IGEL CEO Jed Ayres on Edge and...

      James Maguire - June 14, 2022 0
      I spoke with Jed Ayres, CEO of IGEL, about the endpoint sector, and an open source OS for the cloud; we also spoke about...
      Read more
      IT Management

      Intuit’s Nhung Ho on AI for the...

      James Maguire - May 13, 2022 0
      I spoke with Nhung Ho, Vice President of AI at Intuit, about adoption of AI in the small and medium-sized business market, and how...
      Read more
      Applications

      Kyndryl’s Nicolas Sekkaki on Handling AI and...

      James Maguire - November 9, 2022 0
      I spoke with Nicolas Sekkaki, Group Practice Leader for Applications, Data and AI at Kyndryl, about how companies can boost both their AI and...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2022 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×