Close
  • Latest News
  • Artificial Intelligence
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Artificial Intelligence
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Applications
    • Applications
    • Database

    Hadoop Striving for Maturity, Credibility in the Enterprise

    By
    Eric Lundquist
    -
    June 27, 2013
    Share
    Facebook
    Twitter
    Linkedin
      Hadoop

      SAN JOSE, Calif.—The enterprise and Hadoop should be the perfect marriage for the next wave of corporate data analysis technology. What could be more enticing than a technology platform that promises to mix the old with the new and come up with “voila!”—a computing engine to outpace your competition?

      At this week’s 2013 Hadoop summit, 2,500 enthusiastic attendees were treated to sessions that included “Hadoop Turns a Corner and Sees the Future,” “Hadoop Powers Next-Generation Enterprise Data Architectures” and “Putting Hadoop to Work in the Enterprise.” While Hadoop has indeed matured over the six summits since its foundational roots were established in 2005, current enthusiasm is not yet being translated into broad corporate acceptance.

      Gartner Research Vice President Merv Adrian gave attendees a preview of Gartner’s 2013 big data survey. The survey delved into investments in big data and found an “intractable third of the marketplace”—meaning the companies with no plans to invest in big data projects remained essentially unchanged from 2012’s results. The only significant shift was in sharp decline in respondents who answered they did not know if their company had a big data plan: from 11 percent in 2012 to 5 percent in 2013.

      While big data (which is tough to define in the first place) is not an exact match for Hadoop uptake, the term and the vendors building their business around the Hadoop open-source Apache project are intertwined. Those vendors—led by conference sponsor Hortonworks—and the attendees are ready for an outpouring of Hadoop-based projects. But what will it take to move that “intractable third” into the corporate investment stage.

      Hadoop supporters are hoping that the features added into Hadoop 2.0—notably the YARN resource manager—will convince even those intractable ones to move into the planning and then into the implementation category. The YARN feature in Hadoop 2.0 has some compelling enterprise characteristics.

      YARN (yet another resource negotiator) is a big step in moving Hadoop from its massively scalable, but batch-oriented single-application roots to a multi-application engine. In his blog, Arun Murthy (one of the first Hadoop developers), said that “with YARN we now have the ability to run SQL IN Hadoop. For by being in Hadoop (built on YARN), it becomes part of the platform itself and can be managed by YARN to ensure that multiple use cases can be addressed. Why stop at SQL? What about machine learning or modeling? What about processing events (data) as they arrive? Would it be not nice to manage all of these through a common system?”

      Hadoop Striving for Maturity, Credibility in the Enterprise

      The discussion surrounding YARN was a big piece of the Hadoop summit as it should have been. The ability to add an enterprise-class resource manager allows for numerous applications to be created from the data (the “data lake” as one keynoter described it) contained in a corporation.

      The ultimate goal for companies is to merge their traditional row- and column-based data (which, while an older model, still has many of the security and privacy features still under development in Hadoop) with the massively scalable social and machine data within Hadoop. As one presenter explained, financial systems can track sales but Hadoop systems can uncover the customer sentiment surrounding those sales. The two systems in tandem would represent a major step forward in corporate computing.

      Hadoop is an open-source project overseen by the Apache Software Foundation, and in addition to YARN, there are ambitious projects, including the Knox security project. The Hadoop 2.0 version is still in beta format, but the nature of open-source development will see this project move, maybe not as fast as some would like, but transparently.

      Hortonworks, spun out of Yahoo in 2011 and the recent recipient of an additional $50 million in financing, is the most vocal advocate of Hadoop being implemented in its “purest” open-source form. The combination of new features in Hadoop and an increase in applications that can give customers a strategic advantage based on melding old and new systems could be just the thing to turn the intractable third into the “let’s get going on the next big thing” category.

      Eric Lundquist is a technology analyst at Ziff Brothers Investments, a private investment firm. Lundquist, who was editor in chief at eWEEK (previously PC WEEK) from 1996-2008, authored this article for eWEEK to share his thoughts on technology, products and services. No investment advice is offered in this article. All duties are disclaimed. Lundquist works separately for a private investment firm, which may at any time invest in companies whose products are discussed in this article and no disclosure of securities transactions will be made.

      Eric Lundquist
      Since 1996, Eric Lundquist has been Editor in Chief of eWEEK, which includes domestic, international and online editions. As eWEEK's EIC, Lundquist oversees a staff of nearly 40 editors, reporters and Labs analysts covering product, services and companies in the high-technology community. He is a frequent speaker at industry gatherings and user events and sits on numerous advisory boards. Eric writes the popular weekly column, 'Up Front,' and he is a confidant of eWEEK's Spencer F. Katt gossip columnist.
      Get the Free Newsletter!
      Subscribe to Daily Tech Insider for top news, trends & analysis
      This email address is invalid.
      Get the Free Newsletter!
      Subscribe to Daily Tech Insider for top news, trends & analysis
      This email address is invalid.

      MOST POPULAR ARTICLES

      Latest News

      Zeus Kerravala on Networking: Multicloud, 5G, and...

      James Maguire - December 16, 2022 0
      I spoke with Zeus Kerravala, industry analyst at ZK Research, about the rapid changes in enterprise networking, as tech advances and digital transformation prompt...
      Read more
      Applications

      Datadog President Amit Agarwal on Trends in...

      James Maguire - November 11, 2022 0
      I spoke with Amit Agarwal, President of Datadog, about infrastructure observability, from current trends to key challenges to the future of this rapidly growing...
      Read more
      Applications

      Kyndryl’s Nicolas Sekkaki on Handling AI and...

      James Maguire - November 9, 2022 0
      I spoke with Nicolas Sekkaki, Group Practice Leader for Applications, Data and AI at Kyndryl, about how companies can boost both their AI and...
      Read more
      Cloud

      IGEL CEO Jed Ayres on Edge and...

      James Maguire - June 14, 2022 0
      I spoke with Jed Ayres, CEO of IGEL, about the endpoint sector, and an open source OS for the cloud; we also spoke about...
      Read more
      Careers

      SThree’s Sunny Ackerman on Tech Hiring Trends

      James Maguire - June 9, 2022 0
      I spoke with Sunny Ackerman, President/Americas for tech recruiter SThree, about the tight labor market in the tech sector, and much needed efforts to...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2022 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×