Close
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Applications
    • Applications
    • Cloud
    • IT Management
    • Networking
    • Storage

    Amazon Uses Hadoop for New Cloud Computing Initiative

    By
    Jeff Burt
    -
    April 2, 2009
    Share
    Facebook
    Twitter
    Linkedin

      Amazon Web Services is using the open-source Apache Hadoop distributed computing technology to make it easier for users to access large amounts of computing power to run data-intensive tasks.

      AWS (Amazon Web Services) April 2 announced the public beta of its Amazon Elastic MapReduce initiative, a service designed for businesses, researchers and analysts who have large number-crunching projects list Web indexing, data mining, financial analysis and scientific simulations, according to AWS officials.

      Using a hosted Hadoop framework, users can instantly provision as much compute capacity they need from Amazon’s EC2 (Elastic Compute Cloud) platform to perform the tasks, and pay only for what they use. To sign up for the service, go here.

      Hadoop, the open-source version of Google’s MapReduce, is already being used by such companies as Yahoo and Facebook. Google only uses Hadoop internally.

      HP is challenging Google, Amazon and Sun with its Cloud Assure.

      There are efforts underway to increase the use of Hadoop in enterprise data centers. Most recently, a startup, Cloudera-which calls itself the commercial Hadoop company-announced March 16 the availability of its first product, the Cloudera Distribution for Hadoop. The product lets users store and process petabytes of data that many times is distributed among thousands of servers.

      Cloudera also created a portal to help users install and use the company’s free product.

      “Cloudera is advancing Hadoop technology to make it easier for everyone to store and process the same types of big data that large Web companies are successfully using in their businesses,” Christophe Bisciglia, the founder of Cloudera and former manager of Google’s Hadoop cluster, said in a statement at the time of Cloudera’s announcement.

      According to AWS officials, using Hadoop and other MapReduce-based clusters on the Amazon EC2 cloud computing platform was a difficult task that forced users to do their own set up, management and cluster tuning. With Amazon Elastic MapReduce, those tasks are less time-consuming and more affordable, enabling users to quickly build up and take down Hadoop-based clusters on EC2 in moments.

      AWS also is offering sample applications and tutorials to help users get more comfortable with the new service. Amazon Elastic MapReduce automatically deploys and configures the number of EC2 instances users ask for, then launches a Hadoop implementation of the MapReduce tool. MapReduce then loads the data from Amazon S3 (Simple Storage Service) and divides it so it can be processed in a parallel fashion. The data is then recombined after processing, with the end results put back into S3.

      “Some researchers and developers already run Hadoop on Amazon EC2, and many of them have asked for even simpler tools for large-scale data analysis,” Adam Selipsky, vice president of product management and developer relations at AWS, said in a statement.

      Jeff Burt
      Jeffrey Burt has been with eWEEK since 2000, covering an array of areas that includes servers, networking, PCs, processors, converged infrastructure, unified communications and the Internet of things.

      MOST POPULAR ARTICLES

      Cybersecurity

      Visa’s Michael Jabbara on Cybersecurity and Digital...

      James Maguire - May 17, 2022 0
      I spoke with Michael Jabbara, VP and Global Head of Fraud Services at Visa, about the cybersecurity technology used to ensure the safe transfer...
      Read more
      Cloud

      Yotascale CEO Asim Razzaq on Controlling Multicloud...

      James Maguire - May 5, 2022 0
      Asim Razzaq, CEO of Yotascale, provides guidance on understanding—and containing—the complex cost structure of multicloud computing. Among the topics we covered:  As you survey the...
      Read more
      Big Data and Analytics

      GoodData CEO Roman Stanek on Business Intelligence...

      James Maguire - May 4, 2022 0
      I spoke with Roman Stanek, CEO of GoodData, about business intelligence, data as a service, and the frustration that many executives have with data...
      Read more
      IT Management

      Intuit’s Nhung Ho on AI for the...

      James Maguire - May 13, 2022 0
      I spoke with Nhung Ho, Vice President of AI at Intuit, about adoption of AI in the small and medium-sized business market, and how...
      Read more
      Applications

      Cisco’s Thimaya Subaiya on Customer Experience in...

      James Maguire - May 10, 2022 0
      I spoke with Thimaya Subaiya, SVP and GM of Global Customer Experience at Cisco, about the factors that create good customer experience – and...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2021 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×