Close
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Cloud
    • Cloud
    • Development

    Google Cloud Unveils Hadoop Connectors, New App Engine Version

    By
    Todd R. Weiss
    -
    April 19, 2014
    Share
    Facebook
    Twitter
    Linkedin

      The Google Cloud Platform is expanding its capabilities with Hadoop through new connectors that can be used with Google BigQuery and Google Cloud Datastore to run Hadoop queries. Also bolstering the cloud platform is a new version of Google App Engine that includes scalability and performance improvements.

      The new Hadoop connectors were announced by Pratul Dublish, a cloud platform product manager, in an April 16 post on the Google Cloud Platform Blog.

      “Today, we are making it easier for you to run Hadoop jobs directly against your data in Google BigQuery and Google Cloud Datastore with the Preview release of Google BigQuery connector and Google Cloud Datastore connector for Hadoop,” wrote Dublish. “The Google BigQuery and Google Cloud Datastore connectors implement Hadoop’s InputFormat and OutputFormat interfaces for accessing data. These two connectors complement the existing Google Cloud Storage connector for Hadoop, which implements the Hadoop Distributed File System interface for accessing data in Google Cloud Storage.”

      To use the connectors, they can be automatically installed and configured when deploying your Hadoop cluster using the bdutil command and by including some extra code, wrote Dublish.

      “These three connectors allow you to directly access data stored in Google Cloud Platform’s storage services from Hadoop and other Big Data open source software that use Hadoop’s IO abstractions,” the post states. “As a result, your valuable data is available simultaneously to multiple Big Data clusters and other services, without duplications. This should dramatically simplify the operational model for your Big Data processing on Google Cloud Platform.”

      Several MapReduce code samples are available for inspection to help users make the connections. Sample code is included for using the BigQuery connector, for using the Datastore connector and for using the Datastore connector for reading data and using the BigQuery connector for publishing results, wrote Dublish.

      In a related announcement, the latest version of Google App Engine, Version 1.9.3, was unveiled by Google in an April post on the Google Cloud Platform Blog. The new version includes stability and scalability improvements to help users with their core projects, according to Google. “We know that you rely on App Engine for critical applications, and with the significant growth we’ve experienced over the past couple years we wanted to take a step back and spend a few release cycles with a laser focus on the core functionality that impacts your service and end users. As a result, new features and functionality may take a back seat to these improvements.”

      Google is often tweaking its Google Cloud Platform and adding new services for users and developers.

      Earlier in April, Google announced that it is now making its Google Cloud Platform services available in the Asia Pacific region as it moves to expand the reach of its cloud services to more developers around the world. That means that developers there will have access to Google’s latest cloud technology, including Andromeda—the code name for Google’s network virtualization stack—as well as transparent maintenance with live migration and automatic restart for Compute Engine.

      Also earlier in April, Google unveiled new lower pricing for Google Cloud Platform users through “Sustained Use Discounts” that the company made available to users who run large projects on virtual machines. Under the new pricing scheme, users will save more as they use more virtual machines in the Google Cloud.

      In March, Google introduced a new Google APIs Client Library for .NET and improved documentation for using third-party Puppet, Chef, Salt and Ansible configuration-management tools, according to an eWEEK report. The new Google APIs Client Library for .NET is an open-source effort, hosted at NuGet, that lets developers building on the Microsoft .NET Framework integrate their desktop or Windows Phone applications with Google’s services. The library includes more than 50 Google APIs for Windows developers.

      Also released in March was a new Google paper, “Compute Engine Management with Puppet, Chef, Salt, and Ansible,” which provides information for Google Cloud Platform developers who want to use configuration-management tools such as those from Puppet, Salt, Chef and Ansible.

      In October 2013, Google replaced its old Google API Console with a new, expanded and redesigned Google Cloud Console to help developers organize and use the more than 60 APIs offered by Google. The company also released several technical papers to help cloud developers learn more about the development tools it offers through its Google Compute Engine services. The papers, “Overview of Google Compute Engine for Cloud Developers” and “Building High Availability Applications on Google Compute Engine,” offer insights and details about how the platform can be used and developed for business users.

      Todd R. Weiss
      As a technology journalist covering enterprise IT for more than 15 years, I joined eWEEK.com in September 2014 as the site's senior writer covering all things mobile. I write about smartphones, tablets, laptops, assorted mobile gadgets and services,mobile carriers and much more. I formerly was a staff writer for Computerworld.com from 2000 to 2008 and previously wrote for daily newspapers in eastern Pennsylvania. I'm an avid traveler, motorcyclist, technology lover, cook, reader, tinkerer and mechanic. I drove a yellow taxicab in college and collect toy taxis and taxi business cards from around the world.

      MOST POPULAR ARTICLES

      Big Data and Analytics

      Alteryx’s Suresh Vittal on the Democratization of...

      James Maguire - May 31, 2022 0
      I spoke with Suresh Vittal, Chief Product Officer at Alteryx, about the industry mega-shift toward making data analytics tools accessible to a company’s complete...
      Read more
      Cybersecurity

      Visa’s Michael Jabbara on Cybersecurity and Digital...

      James Maguire - May 17, 2022 0
      I spoke with Michael Jabbara, VP and Global Head of Fraud Services at Visa, about the cybersecurity technology used to ensure the safe transfer...
      Read more
      Cloud

      IGEL CEO Jed Ayres on Edge and...

      James Maguire - June 14, 2022 0
      I spoke with Jed Ayres, CEO of IGEL, about the endpoint sector, and an open source OS for the cloud; we also spoke about...
      Read more
      Applications

      Cisco’s Thimaya Subaiya on Customer Experience in...

      James Maguire - May 10, 2022 0
      I spoke with Thimaya Subaiya, SVP and GM of Global Customer Experience at Cisco, about the factors that create good customer experience – and...
      Read more
      Big Data and Analytics

      GoodData CEO Roman Stanek on Business Intelligence...

      James Maguire - May 4, 2022 0
      I spoke with Roman Stanek, CEO of GoodData, about business intelligence, data as a service, and the frustration that many executives have with data...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2022 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×