Close
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Cloud
    • Cloud

    Microsoft Unleashes Apache Storm on Its Analytics Cloud

    By
    Pedro Hernandez
    -
    October 15, 2014
    Share
    Facebook
    Twitter
    Linkedin
      Microsoft cloud

      Microsoft upped its cloud analytics game at the Strata + Hadoop World conference in New York by announcing Apache Storm support in HDInsight, the company’s cloud-based distribution of Hadoop, a popular open-source big data processing platform.

      “Available in preview today, we are supporting Apache Storm in HDInsight, allowing our customers to process millions of items of Hadoop data from their Internet of things devices in near-real time using a fully managed Hadoop service,” announced T.K. Rengarajan, corporate vice president of Microsoft’s Data Platform, in an Oct. 15 statement. “By bringing real-time analytics capabilities to HDInsight, we are opening up new customer scenarios, such as the ability to analyze operational data in real time for predictive maintenance.”

      Apache Storm is an open-source project that makes it possible to process large data streams in real time. In its support documentation, Microsoft describes the technology as “a distributed, fault-tolerant, open-source computation system that allows you to process data in real time. Storm solutions can also provide guaranteed processing of data, with the ability to replay data that was not successfully processed the first time.”

      According to the Apache Software Foundation, Storm does “for real-time processing what Hadoop did for batch processing.” Storm is currently being used by Twitter, Spotify and Alibaba, among others, to help handle their large-scale data processing requirements.

      With today’s announcement, Microsoft has joined the bandwagon. “The preview availability of Storm in HDInsight continues Microsoft’s investment in the Hadoop ecosystem and HDInsight,” said Rengarajan.

      HDInsight Storm is available as a managed cluster within Azure, where it can be integrated into other Azure services. “For example, Storm might consume data from services such as ServiceBus Queues or Event Hub, and use Websites or Cloud Services to provide data visualization,” explained Microsoft.

      In addition to enabling real-time big data analytics, Microsoft envisions that customers will leverage HDInsight Storm to power their online machine learning efforts.

      “Storm can be used with a machine learning solution that has previously been trained by batch processing, such as a solution based on Mahout,” Apache’s machine learning and data mining project, according to the HDInsight Storm FAQ. “However its generic, distributed computation model also opens the door for stream-based machine learning solutions.”

      Azure HDInsight Storm supports .NET, Java and Python. Microsoft admits that while Storm supports other languages—any programming according to Apache—enabling additional programming support will require HDInsight cluster configuration changes.

      In related news, Microsoft revealed that Hadoop vendor Hortonworks’s big data software platform will feature Microsoft Azure integrations. Also new are fresh additions to the company’s Azure Machine Learning ecosystem, including a recommendation engine, an anomaly-detection service and a batch of R packages, the programming language preferred by data scientists.

      “These announcements and our participation in the [Strata + Hadoop World] event are part of our commitment to bring big data to everyone by leveraging the power, flexibility and scale of the cloud,” stated Rengarajan.

      Pedro Hernandez
      Pedro Hernandez is a contributor to eWEEK and the IT Business Edge Network, the network for technology professionals. Previously, he served as a managing editor for the Internet.com network of IT-related websites and as the Green IT curator for GigaOM Pro.

      MOST POPULAR ARTICLES

      Big Data and Analytics

      Alteryx’s Suresh Vittal on the Democratization of...

      James Maguire - May 31, 2022 0
      I spoke with Suresh Vittal, Chief Product Officer at Alteryx, about the industry mega-shift toward making data analytics tools accessible to a company’s complete...
      Read more
      Cybersecurity

      Visa’s Michael Jabbara on Cybersecurity and Digital...

      James Maguire - May 17, 2022 0
      I spoke with Michael Jabbara, VP and Global Head of Fraud Services at Visa, about the cybersecurity technology used to ensure the safe transfer...
      Read more
      Applications

      Cisco’s Thimaya Subaiya on Customer Experience in...

      James Maguire - May 10, 2022 0
      I spoke with Thimaya Subaiya, SVP and GM of Global Customer Experience at Cisco, about the factors that create good customer experience – and...
      Read more
      Big Data and Analytics

      GoodData CEO Roman Stanek on Business Intelligence...

      James Maguire - May 4, 2022 0
      I spoke with Roman Stanek, CEO of GoodData, about business intelligence, data as a service, and the frustration that many executives have with data...
      Read more
      Cloud

      Yotascale CEO Asim Razzaq on Controlling Multicloud...

      James Maguire - May 5, 2022 0
      Asim Razzaq, CEO of Yotascale, provides guidance on understanding—and containing—the complex cost structure of multicloud computing. Among the topics we covered:  As you survey the...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2022 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×