Close
  • Latest News
  • Artificial Intelligence
  • Video
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Subscribe
Logo
  • Latest News
  • Artificial Intelligence
  • Video
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Subscribe
    Home Database
    • Database

    Intel Releases Hadoop Distribution for Big Data

    Written by

    Jeff Burt
    Published February 26, 2013
    Share
    Facebook
    Twitter
    Linkedin

      eWEEK content and product recommendations are editorially independent. We may make money when you click on links to our partners. Learn More.

      Intel is releasing its own distribution of Apache Hadoop, a move that not only helps push forward its software ambitions, but also will make it a significant player in the booming area of big data and help fuel sales of its Xeon server processors.

      During a Webcast press conference Feb. 26, Boyd Davis, vice president and general manager of Intel’s Data Center Software division, said the giant chip maker has been working with Hadoop since 2009—this is actually Intel’s third release of its Hadoop software—and has been an open-source advocate for much longer than that. However, for Intel to be more than an outside influence in the big data space, it had to become a player with products to offer, Davis said. The Intel Distribution for Apache Hadoop was a way to do that.

      Intel’s legacy in high-end data center hardware—including its Xeon server chips and recent offerings around solid-state drive (SSD) memory—and newer efforts in software give the company a strong silicon-based foundation for launching a Hadoop distribution, he said. Intel is optimizing Hadoop to work with features on its chips, such as incorporating Advanced Encryption Standard New Instructions (AES-NI) for accelerating encryption into the Hadoop Distributed File System.

      Intel, which has been building up its software capabilities via in-house development and acquisitions, will keep open parts of its Hadoop distribution—making them interoperable with other Hadoop distributions—but will keep some features, including management and monitoring capabilities, to itself. Intel will not open source such software as Intel Manager for Apache Hadoop—for configuration and deployment—or Active Tuner for Apache Hadoop, a tool for improving the performance of compute clusters running the distribution.

      What Intel’s Hadoop distribution will do is give organizations the confidence that comes when a major tech player supports an open-source technology, providing a “consistent, stable foundation” for the open-source software, Davis said, adding that Intel wants “to make sure Hadoop stays on the leading edge.” More vendors, from established players like EMC to smaller companies like Cloudera, are coming out with their own Hadoop offerings.

      Big data is becoming a growing trend in the business world, with a staggering amount of data being created from the wide range of devices and machines people are using. Davis pointed to numbers indicating that every 11 seconds, a petabye of data is created around the world.

      “We’re in an era of generating huge amounts of data,” he said, noting that “the key is how to get value out of the data.”

      Hadoop, which includes about a dozen open-source projects, is designed to enable businesses to more easily do just that: store huge amounts of data, analyze it and leverage it in ways that benefit both the organizations and their end users. For example, businesses can use it to gain a better understanding of what their customers want, while medical researchers can more quickly discover life-saving drugs and communities can improve their environments by better managing traffic patterns.

      “Big data has the potential to not only transform business models … but has the ability to transform society,” Davis said.

      Intel Releases Hadoop Distribution for Big Data

      Intel’s move comes the same week that other players have made significant advances in big data and Hadoop. Hewlett-Packard announced a Hadoop plug-in for its ArcSight security software that will make it easier and faster for organizations to run through huge amounts of security data. Hortonworks’ new beta of its Hadoop Data Platform will run on Microsoft’s Windows Server, and EMC announced Feb. 25 a new Hadoop distribution, Pivotal HD, that works closely with the storage vendor’s Greenplum massively parallel processing (MMP) database.

      Davis said Intel will leave much of the application work to its partners, but that the chip maker will create a foundation for Hadoop that will enable organizations to leverage the capabilities in its data center hardware. Intel’s AES-NI technology will enable up to 20 times the encryption speed of other technologies, while Intel’s SSD and cache acceleration will offer queries in Hive—the data warehouse system in Hadoop—that are 8.5 times faster. The combination of Intel’s silicon and its Hadoop distribution means that analyzing a terabyte of data, which normally would take as long as 4 hours, can now be done in 7 minutes, according to Intel.

      During the Webcast, Intel offered a long list of partners to help integrate its software into various platforms, including Cisco Systems, Cray, Dell, Infosys, NextBio, Red Hat, SAP, SAS, Savvis and Teradata. SuperMicro announced Feb. 26 that it was adding Intel’s Hadoop distribution to some of its servers and storage systems aimed at big data environments.

      Intel’s investment arm, Intel Capital, also is investing in smaller big data companies, such as 10gen and Guavus Analytics.

      The strong move into big data also will help fuel sales of its Xeon chips, driving organizations to run their big data workloads on Intel-based servers from the likes of HP and Dell. Davis said that “one of [Intel’s] biggest motivators is to drive faster growth of the data center.”

      Jeff Burt
      Jeff Burt
      Jeffrey Burt has been with eWEEK since 2000, covering an array of areas that includes servers, networking, PCs, processors, converged infrastructure, unified communications and the Internet of things.

      Get the Free Newsletter!

      Subscribe to Daily Tech Insider for top news, trends & analysis

      Get the Free Newsletter!

      Subscribe to Daily Tech Insider for top news, trends & analysis

      MOST POPULAR ARTICLES

      Artificial Intelligence

      9 Best AI 3D Generators You Need...

      Sam Rinko - June 25, 2024 0
      AI 3D Generators are powerful tools for many different industries. Discover the best AI 3D Generators, and learn which is best for your specific use case.
      Read more
      Cloud

      RingCentral Expands Its Collaboration Platform

      Zeus Kerravala - November 22, 2023 0
      RingCentral adds AI-enabled contact center and hybrid event products to its suite of collaboration services.
      Read more
      Artificial Intelligence

      8 Best AI Data Analytics Software &...

      Aminu Abdullahi - January 18, 2024 0
      Learn the top AI data analytics software to use. Compare AI data analytics solutions & features to make the best choice for your business.
      Read more
      Latest News

      Zeus Kerravala on Networking: Multicloud, 5G, and...

      James Maguire - December 16, 2022 0
      I spoke with Zeus Kerravala, industry analyst at ZK Research, about the rapid changes in enterprise networking, as tech advances and digital transformation prompt...
      Read more
      Video

      Datadog President Amit Agarwal on Trends in...

      James Maguire - November 11, 2022 0
      I spoke with Amit Agarwal, President of Datadog, about infrastructure observability, from current trends to key challenges to the future of this rapidly growing...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2024 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.