Close
  • Latest News
  • Cybersecurity
  • Big Data and Analytics
  • Cloud
  • Mobile
  • Networking
  • Storage
  • Applications
  • IT Management
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Menu
eWEEK.com
Search
eWEEK.com
  • Latest News
  • Cybersecurity
  • Big Data and Analytics
  • Cloud
  • Mobile
  • Networking
  • Storage
  • Applications
  • IT Management
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Development
    • Development
    • IT Management
    • Servers
    • Virtualization

    LinkedIn Releases Kafka-monitoring Cruise Control to Open Source

    By
    CHRIS PREIMESBERGER
    -
    August 31, 2017
    Share
    Facebook
    Twitter
    Linkedin
      LinkedIn.Cruise.Control

      LinkedIn, well known inside the development community for its innovation, is probably most famous for its development of Kafka, an open-source stream processing platform that provides a unified, high-throughput, low-latency platform for handling real-time data feeds.

      Now the social network for professionals has done it again. On Aug. 28 it released to the open source community something called Cruise Control, a general-purpose system that continually monitors server clusters and automatically adjusts the resources allocated to them to meet pre-defined performance goals.

      Cruise Control and Kafka work hand in hand. In essence, as Kafka users specify performance goals, Cruise Control monitors server clusters for violations of these goals, analyzes the existing workload on the cluster and automatically executes administrative operations to satisfy those goals. Like most new-gen IT, it’s all about speed and automation.

      You can view a video here about how Cruise Control works.

      It’s a fact that Apache Kafka’s popularity has grown substantially during the past few years. In fact, LinkedIn’s deployment itself, consisting of more than 1,800 servers, recently surpassed a staggering 2 trillion messages per day.

      While Kafka has proven to be stable, there are still operational challenges when running Kafka at such a scale, LinkedIn developer Jiangjie Qin wrote in a blogpost. Servers fail on a daily basis, which results in unbalanced workloads on clusters. As a result, SREs expend significant time and effort to reassign partitions in order to restore balance to Kafka clusters, Qin said.

      “Intelligent automation is critical under these circumstances, which is why we developed Cruise Control,” Qin wrote.

      To obtain more details on Cruise Control, check Qin’s blog and check this reference.

      MOST POPULAR ARTICLES

      Android

      Samsung Galaxy XCover Pro: Durability for Tough...

      CHRIS PREIMESBERGER - December 5, 2020 0
      Have you ever dropped your phone, winced and felt the pain as it hit the sidewalk? Either the screen splintered like a windshield being...
      Read more
      Cloud

      Why Data Security Will Face Even Harsher...

      CHRIS PREIMESBERGER - December 1, 2020 0
      Who would know more about details of the hacking process than an actual former career hacker? And who wants to understand all they can...
      Read more
      Cybersecurity

      How Veritas Is Shining a Light Into...

      EWEEK EDITORS - September 25, 2020 0
      Protecting data has always been one of the most important tasks in all of IT, yet as more companies become data companies at the...
      Read more
      Big Data and Analytics

      How NVIDIA A100 Station Brings Data Center...

      ZEUS KERRAVALA - November 18, 2020 0
      There’s little debate that graphics processor unit manufacturer NVIDIA is the de facto standard when it comes to providing silicon to power machine learning...
      Read more
      Apple

      Why iPhone 12 Pro Makes Sense for...

      WAYNE RASH - November 26, 2020 0
      If you’ve been watching the Apple commercials for the past three weeks, you already know what the company thinks will happen if you buy...
      Read more
      eWeek


      Contact Us | About | Sitemap

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Property of TechnologyAdvice.
      Terms of Service | Privacy Notice | Advertise | California - Do Not Sell My Info

      © 2020 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×