Close
  • Latest News
  • Artificial Intelligence
  • Video
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Subscribe
Logo
  • Latest News
  • Artificial Intelligence
  • Video
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Subscribe
    Home Cloud
    • Cloud

    Microsoft Unleashes Apache Storm on Its Analytics Cloud

    Written by

    Pedro Hernandez
    Published October 15, 2014
    Share
    Facebook
    Twitter
    Linkedin

      eWEEK content and product recommendations are editorially independent. We may make money when you click on links to our partners. Learn More.

      Microsoft upped its cloud analytics game at the Strata + Hadoop World conference in New York by announcing Apache Storm support in HDInsight, the company’s cloud-based distribution of Hadoop, a popular open-source big data processing platform.

      “Available in preview today, we are supporting Apache Storm in HDInsight, allowing our customers to process millions of items of Hadoop data from their Internet of things devices in near-real time using a fully managed Hadoop service,” announced T.K. Rengarajan, corporate vice president of Microsoft’s Data Platform, in an Oct. 15 statement. “By bringing real-time analytics capabilities to HDInsight, we are opening up new customer scenarios, such as the ability to analyze operational data in real time for predictive maintenance.”

      Apache Storm is an open-source project that makes it possible to process large data streams in real time. In its support documentation, Microsoft describes the technology as “a distributed, fault-tolerant, open-source computation system that allows you to process data in real time. Storm solutions can also provide guaranteed processing of data, with the ability to replay data that was not successfully processed the first time.”

      According to the Apache Software Foundation, Storm does “for real-time processing what Hadoop did for batch processing.” Storm is currently being used by Twitter, Spotify and Alibaba, among others, to help handle their large-scale data processing requirements.

      With today’s announcement, Microsoft has joined the bandwagon. “The preview availability of Storm in HDInsight continues Microsoft’s investment in the Hadoop ecosystem and HDInsight,” said Rengarajan.

      HDInsight Storm is available as a managed cluster within Azure, where it can be integrated into other Azure services. “For example, Storm might consume data from services such as ServiceBus Queues or Event Hub, and use Websites or Cloud Services to provide data visualization,” explained Microsoft.

      In addition to enabling real-time big data analytics, Microsoft envisions that customers will leverage HDInsight Storm to power their online machine learning efforts.

      “Storm can be used with a machine learning solution that has previously been trained by batch processing, such as a solution based on Mahout,” Apache’s machine learning and data mining project, according to the HDInsight Storm FAQ. “However its generic, distributed computation model also opens the door for stream-based machine learning solutions.”

      Azure HDInsight Storm supports .NET, Java and Python. Microsoft admits that while Storm supports other languages—any programming according to Apache—enabling additional programming support will require HDInsight cluster configuration changes.

      In related news, Microsoft revealed that Hadoop vendor Hortonworks’s big data software platform will feature Microsoft Azure integrations. Also new are fresh additions to the company’s Azure Machine Learning ecosystem, including a recommendation engine, an anomaly-detection service and a batch of R packages, the programming language preferred by data scientists.

      “These announcements and our participation in the [Strata + Hadoop World] event are part of our commitment to bring big data to everyone by leveraging the power, flexibility and scale of the cloud,” stated Rengarajan.

      Pedro Hernandez
      Pedro Hernandez
      Pedro Hernandez is a writer for eWEEK and the IT Business Edge Network, the network for technology professionals. Previously, he served as a managing editor for the Internet.com network of IT-related websites and as the Green IT curator for GigaOM Pro.

      Get the Free Newsletter!

      Subscribe to Daily Tech Insider for top news, trends & analysis

      Get the Free Newsletter!

      Subscribe to Daily Tech Insider for top news, trends & analysis

      MOST POPULAR ARTICLES

      Artificial Intelligence

      9 Best AI 3D Generators You Need...

      Sam Rinko - June 25, 2024 0
      AI 3D Generators are powerful tools for many different industries. Discover the best AI 3D Generators, and learn which is best for your specific use case.
      Read more
      Cloud

      RingCentral Expands Its Collaboration Platform

      Zeus Kerravala - November 22, 2023 0
      RingCentral adds AI-enabled contact center and hybrid event products to its suite of collaboration services.
      Read more
      Artificial Intelligence

      8 Best AI Data Analytics Software &...

      Aminu Abdullahi - January 18, 2024 0
      Learn the top AI data analytics software to use. Compare AI data analytics solutions & features to make the best choice for your business.
      Read more
      Latest News

      Zeus Kerravala on Networking: Multicloud, 5G, and...

      James Maguire - December 16, 2022 0
      I spoke with Zeus Kerravala, industry analyst at ZK Research, about the rapid changes in enterprise networking, as tech advances and digital transformation prompt...
      Read more
      Video

      Datadog President Amit Agarwal on Trends in...

      James Maguire - November 11, 2022 0
      I spoke with Amit Agarwal, President of Datadog, about infrastructure observability, from current trends to key challenges to the future of this rapidly growing...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2024 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.