Nodeable's StreamReduce Gives Hadoop a Real-Time Shot in the Arm

By Chris Preimesberger  |  Posted 2012-07-19 Print this article Print

New cloud service processes and analyzing streams of data in real time, speeds up Hadoop deployments.

Apache Hadoop is all the rage in enterprises that are installing new big data workload analytics deployments, and it is proving to be a huge asset for many IT and line-of-business decision makers.

But the popular batch-processing engine does have its weaknesses. One of them is that it isn't particularly fast to start up, because it has to get its arms around all that big data in the workload.

Another is that it doesn't come with an intuitive interface; for that, one needs to go to Cloudera, Greenplum, Hortonworks or another of the 120 or so providers now out there.

Another important "con," such as it is, is that Hadoop works on its own time, offline, and cannot offer results in any sort of real-time scenario.

However, there's now an app for that, and it comes from an unlikely source.

San Francisco-based Nodeable, which started up in 2011 as a Twitter-like notification service for systems management, has made a pivot in its business strategy, realizing the crying need for helping Hadoop become more user-friendly. Nodeable had a brainstorm, refined its product and is now offering a new cloud service for processing and analyzing streams of data in real time, co-founder and CEO Dave Rosenberg told eWEEK.

The service, called StreamReduce, runs on top of Twitter€™s open-source Storm framework and serves as a much-faster Hadoop front end. It also works with other batch-processing engines, such as Amazon Web Services Elastic Map Reduce.

"For almost a year, the engineering team at Nodeable has worked closely with more than 400 beta users who've told us that a real-time analytics complement to Hadoop is a top priority," Rosenberg said. "Batch workflows are too slow for turning data into useful, actionable information. StreamReduce solves that problem with a simple cloud-based solution."

Using StreamReduce, IT managers can gain immediate insights into their big data using Hadoop processing, giving users the benefits of on-the-spot analysis of their data streams.

Nodeable beta users can deploy StreamReduce for a variety of use cases, including log and clickstream analysis; anomaly detection in Amazon Web Services Elastic Cloud Compute (EC2) instances; security and fraud detection; mobile and geo-location measurement; pinpointed advertising and marketing.

Nodeable's StreamReduce service is available now, Rosenberg said, with pricing starting at $99 per month.
Chris Preimesberger Chris Preimesberger was named Editor-in-Chief of Features & Analysis at eWEEK in November 2011. Previously he served eWEEK as Senior Writer, covering a range of IT sectors that include data center systems, cloud computing, storage, virtualization, green IT, e-discovery and IT governance. His blog, Storage Station, is considered a go-to information source. Chris won a national Folio Award for magazine writing in November 2011 for a cover story on and CEO-founder Marc Benioff, and he has served as a judge for the SIIA Codie Awards since 2005. In previous IT journalism, Chris was a founding editor of both IT Manager's Journal and and was managing editor of Software Development magazine. His diverse resume also includes: sportswriter for the Los Angeles Daily News, covering NCAA and NBA basketball, television critic for the Palo Alto Times Tribune, and Sports Information Director at Stanford University. He has served as a correspondent for The Associated Press, covering Stanford and NCAA tournament basketball, since 1983. He has covered a number of major events, including the 1984 Democratic National Convention, a Presidential press conference at the White House in 1993, the Emmy Awards (three times), two Rose Bowls, the Fiesta Bowl, several NCAA men's and women's basketball tournaments, a Formula One Grand Prix auto race, a heavyweight boxing championship bout (Ali vs. Spinks, 1978), and the 1985 Super Bowl. A 1975 graduate of Pepperdine University in Malibu, Calif., Chris has won more than a dozen regional and national awards for his work. He and his wife, Rebecca, have four children and reside in Redwood City, Calif.Follow on Twitter: editingwhiz

Submit a Comment

Loading Comments...
Manage your Newsletters: Login   Register My Newsletters

Rocket Fuel