Microsoft Unleashes Apache Storm on Its Analytics Cloud
Microsoft continues to flesh out its cloud-based big data portfolio with support for real-time analytics and new machine learning capabilities.Microsoft upped its cloud analytics game at the Strata + Hadoop World conference in New York by announcing Apache Storm support in HDInsight, the company's cloud-based distribution of Hadoop, a popular open-source big data processing platform. "Available in preview today, we are supporting Apache Storm in HDInsight, allowing our customers to process millions of items of Hadoop data from their Internet of things devices in near-real time using a fully managed Hadoop service," announced T.K. Rengarajan, corporate vice president of Microsoft's Data Platform, in an Oct. 15 statement. "By bringing real-time analytics capabilities to HDInsight, we are opening up new customer scenarios, such as the ability to analyze operational data in real time for predictive maintenance." Apache Storm is an open-source project that makes it possible to process large data streams in real time. In its support documentation, Microsoft describes the technology as "a distributed, fault-tolerant, open-source computation system that allows you to process data in real time. Storm solutions can also provide guaranteed processing of data, with the ability to replay data that was not successfully processed the first time." According to the Apache Software Foundation, Storm does "for real-time processing what Hadoop did for batch processing." Storm is currently being used by Twitter, Spotify and Alibaba, among others, to help handle their large-scale data processing requirements.
With today's announcement, Microsoft has joined the bandwagon. "The preview availability of Storm in HDInsight continues Microsoft's investment in the Hadoop ecosystem and HDInsight," said Rengarajan.