Close
  • Latest News
  • Artificial Intelligence
  • Video
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Artificial Intelligence
  • Video
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Applications
    • Applications
    • Big Data and Analytics
    • Cloud
    • IT Management

    Confluent Cloud Uses Apache Kafka for Streaming Data as a Service

    Written by

    Chris Preimesberger
    Published November 29, 2017
    Share
    Facebook
    Twitter
    Linkedin

      eWEEK content and product recommendations are editorially independent. We may make money when you click on links to our partners. Learn More.

      As time and IT innovation move on, we’re seeing more and more clouds for specific purposes.

      These are clouds for verticals that include retail, health care, financial services and science projects. But they also are aimed at specific jobs, such as video processing, genome tracking, oil and gas exploration and others.

      As of Nov. 28, there’s a new cloud in town, one that is purpose-built for streaming data. Confluent, which developed its own streaming-data platform based on Apache Kafka, announced at Amazon re:Invent 2017 in Las Vegas that its Confluent Cloud is now ready for prime time and is available for enterprise production workloads.

      Built by the original creators of Apache Kafka, Confluent Cloud puts into action the company’s expertise gained from managing large streaming environments. This is a fully-managed service that enables enterprises to deploy their customer experience projects, fleet management upgrades, fraud detection and other real-time, large-scale initiatives in one place.

      Open-Source Streaming Data Platform is a Workhorse

      Apache Kafka is an open-source stream processing platform written in Scala and Java by Jay Kreps, Neha Narkhede and Jun Rao while they were working at LinkedIn. It was then open-sourced through the Apache Software Foundation. Kafka provides a unified, high-throughput, low-latency platform for handling real-time data feeds.

      Unlike conventional enterprise messaging software, Kafka is able to handle all the data flowing through a company and do it in near real time. Kafka is a high-performance publish/subscribe message bus designed for high availability and data durability, with minimal latency. Kafka acts as a central data backbone and enables loose coupling between applications (Akka), data processing (Spark) and data persistence (Cassandra) services.

      As the overall volume of data from machines and human-operated devices–mostly from machines–continues to zoom up, IT systems sometimes find themselves straining to keep that data moving from place to place at internet speed.

      All those moving bits are becoming heavy loads for systems old and new. Server and storage software needs to refreshed all the time in order to keep up, or else an enterprise can fall behind its competitors in delivery of services to customers.

      Nutanix, OpenStack, Mesosphere All Use Kafka

      At the outset of the IoT and IIoT (industrial internet of things) age, data center operating systems like Nutanix, OpenStack and Mesosphere are three of the engines that are able to scale up in real time as needed by workload demands.

      One thing in common they all have is–you guessed it: Apache Kafka.

      Confluent’s platform includes Confluent Cloud, Confluent Enterprise and Confluent Open Source, to create a more complete distribution of Kafka intended for large-scale production across a variety of environments. It improves Kafka by expanding its integration capabilities, adding tools to optimize and manage Kafka clusters, and ensuring the streams are secure.

      With Confluent Cloud, enterprises and developers have the option to build and run applications in the cloud, knowing that the team who created Kafka are maintaining and managing the Kafka clusters.  

      Key features include:

      • Latest Kafka capabilities: Always uses the latest Apache Kafka version and so developers never have to worry about upgrades again.
      • Performant: Highest throughput rate of any streaming data service. Standard plan is 5 MB/s and custom plans are available for any scale.
      • Reliable: Optional support for multiple availability zones and 99.95 percent service level agreement.
      • Client support: Full support for the range of clients offered by Confluent, including Java, Python, C/C++, Go and .NET, as well as the Kafka Streams API.
      • Flexible: Configurable retention period, storage and throughput rate to suit any workload.
      • Kafka expertise: Backed by the team that created Kafka that has the most extensive experience operating it at scale.

      “Confluent Cloud is now production ready and capable of handling enterprise workloads, ideal for  companies that are looking for experts to run their Apache Kafka as a Service for them,” Narkhede, co-founder and CTO at Confluent, said. “Enterprises and developers can now focus on building applications that provide value to the business, rather than worrying about managing and running Kafka.”

      Availability and Pricing

      The service is currently available on AWS US-West-2 and US-East-1 Regions, with support for Microsoft Azure and Google Cloud to be added in the future. Confluent Cloud is elastically priced based on usage. Pricing is determined based on throughput, retention and availability.

      For more information, go here.

      Palo Alto, Calif.-based Confluent is at AWS re:Invent 2017 through Nov. 30 at booth No. 1300.

      Chris Preimesberger
      Chris Preimesberger
      https://www.eweek.com/author/cpreimesberger/
      Chris J. Preimesberger is Editor Emeritus of eWEEK. In his 16 years and more than 5,000 articles at eWEEK, he distinguished himself in reporting and analysis of the business use of new-gen IT in a variety of sectors, including cloud computing, data center systems, storage, edge systems, security and others. In February 2017 and September 2018, Chris was named among the 250 most influential business journalists in the world (https://richtopia.com/inspirational-people/top-250-business-journalists/) by Richtopia, a UK research firm that used analytics to compile the ranking. He has won several national and regional awards for his work, including a 2011 Folio Award for a profile (https://www.eweek.com/cloud/marc-benioff-trend-seer-and-business-socialist/) of Salesforce founder/CEO Marc Benioff--the only time he has entered the competition. Previously, Chris was a founding editor of both IT Manager's Journal and DevX.com and was managing editor of Software Development magazine. He has been a stringer for the Associated Press since 1983 and resides in Silicon Valley.
      Linkedin Twitter

      Get the Free Newsletter!

      Subscribe to Daily Tech Insider for top news, trends & analysis

      Get the Free Newsletter!

      Subscribe to Daily Tech Insider for top news, trends & analysis

      MOST POPULAR ARTICLES

      Artificial Intelligence

      9 Best AI 3D Generators You Need...

      Sam Rinko - June 25, 2024 0
      AI 3D Generators are powerful tools for many different industries. Discover the best AI 3D Generators, and learn which is best for your specific use case.
      Read more
      Cloud

      RingCentral Expands Its Collaboration Platform

      Zeus Kerravala - November 22, 2023 0
      RingCentral adds AI-enabled contact center and hybrid event products to its suite of collaboration services.
      Read more
      Artificial Intelligence

      8 Best AI Data Analytics Software &...

      Aminu Abdullahi - January 18, 2024 0
      Learn the top AI data analytics software to use. Compare AI data analytics solutions & features to make the best choice for your business.
      Read more
      Latest News

      Zeus Kerravala on Networking: Multicloud, 5G, and...

      James Maguire - December 16, 2022 0
      I spoke with Zeus Kerravala, industry analyst at ZK Research, about the rapid changes in enterprise networking, as tech advances and digital transformation prompt...
      Read more
      Video

      Datadog President Amit Agarwal on Trends in...

      James Maguire - November 11, 2022 0
      I spoke with Amit Agarwal, President of Datadog, about infrastructure observability, from current trends to key challenges to the future of this rapidly growing...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2024 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×