GigaOm Pundit Suggests Enterprises Have Gone From Hadoop to 'Hadumping'

By Eric Lundquist  |  Posted 2014-03-20 Print this article Print

For that breakaway to happen, the complexity of Hadoop (and the data processing engine Spark) must recede into the background and gain an overlay that's accessible to techies and business executives eager to use the power of aggregated data sources.

3. Big data challenges the big vendors. The traditional database, business intelligence and infrastructure vendors are challenged by open-source software running on commodity hardware and sold as a subscription. This is not a new phenomenon, but the struggles that companies such as Oracle and IBM are having in making the cloud transition are becoming acute.

"Big companies are very incented to fracture the market," said Robert Bearden, CEO of HortonWorks. He explained that a fractured market gives the traditional vendor more time to transition their sales and marketing teams. Meanwhile, enterprise customers want a cohesive market free of proprietary hooks.

The arguments and concerns regarding the fragmentation of Hadoop distributions are real, and the possibility of getting caught by proprietary hooks you aren't aware of is a legitimate concern to CIOs. Traditional vendors restructuring their entire sales, marketing and development organizations to adjust to the open-source reality will be the enterprise story of 2014.

4. The Internet of things may not be a Hadoop thing. In a presentation from still in beta SpaceCurve, CTO Andrew Rogers contended that a new type of platform will be required for real-time data streaming within and from the Internet of things.

The sheer volume of data, the speed with which the data will flow into corporate networks and the need to analyze the data on the fly argue against traditional batch and transaction processing systems as well as newer models including Hadoop. Rogers has a company to promote, but he also has a point about what happens when you try to match up the amount of data heading toward corporations in a sensor-based world and current systems aimed at accumulating and managing mostly human-generated data.

5. Legacy systems aren't going away, but they aren't the future. No one at the Giga event was advocating tossing out all those relational systems and business intelligence platforms already in place at many enterprises. However, the future is in incorporating those systems into new platforms rather than trying to reconfigure those legacy pieces to do something for which they were never intended.

Eric Lundquist is a technology analyst at Ziff Brothers Investments, a private investment firm. Lundquist, who was editor-in-chief at eWEEK (previously PC WEEK) from 1996-2008, authored this article for eWEEK to share his thoughts on technology, products and services. No investment advice is offered in this article. All duties are disclaimed. Lundquist works separately for a private investment firm, which may at any time invest in companies whose products are discussed in this article and no disclosure of securities transactions will be made.



Submit a Comment

Loading Comments...
Manage your Newsletters: Login   Register My Newsletters

Rocket Fuel