The Google Cloud Platform announcements made at the Google I/O 2014 developers conference include a raft of new tools and services aimed at helping with data handling, application development and more.
One of the key tools unveiled so far is Google Cloud Dataflow, which is seen by Google as a successor to the popular MapReduce service, Greg DeMichillie, director of product management for the Google Cloud Platform, wrote in a June 25 posting on the Google Cloud Platform Blog. Cloud Dataflow, which was demonstrated publicly here for the first time, is a managed service that developers can use to create data pipelines that analyze data in both batch and streaming modes, wrote DeMichillie.
“A decade ago, Google invented MapReduce to process massive data sets using distributed computing,” he wrote. “Since then, more devices and information require more capable analytics pipelines—though they are difficult to create and maintain.”
That’s where Cloud Dataflow will help, he wrote.”Cloud Dataflow makes it easy for you to get actionable insights from your data while lowering operational costs without the hassles of deploying, maintaining or scaling infrastructure. You can use Cloud Dataflow for use cases like ETL, batch data processing and streaming analytics, and it will automatically optimize, deploy and manage the code and resources required.”
Another key new tool introduced at the event is Google Cloud Monitoring, which can help users find and fix unusual behaviors across their application stacks, wrote DeMichillie. “Based on technology from our recent acquisition of Stackdriver, Cloud Monitoring provides rich metrics, dashboards and alerting for Cloud Platform, as well as more than a dozen popular open-source apps, including Apache, Nginx, MongoDB, MySQL, Tomcat, IIS, Redis, Elasticsearch and more. For example, you can use Cloud Monitoring to identify and troubleshoot cases where users are experiencing increased error rates connecting from an App Engine module or slow query times from a Cassandra database with minimal configuration.”
One of the included tools, Cloud Trace, can help users isolate the root cause of performance bottlenecks by giving users a visual picture of how much time an application is performing request processing, he wrote, while also allowing users to compare performance between various releases of their application using latency distributions.
A Cloud Debugger tool is also being introduced to help debug applications in production with minimal performance overhead, wrote DeMichillie. “Cloud Debugger gives you a full stack trace and snapshots of all local variables for any watchpoint that you set in your code while your application continues to run undisturbed in production. This brings modern debugging to cloud-based applications.”
Features aimed at helping developers ready their applications for mobile users are also included in the new tools. At the conference, Google demonstrated a beta version of Google Cloud Save, an API used for saving, retrieving and synchronizing user data to the cloud and across devices without needing to code up the backend, he wrote. “Data is stored in Google Cloud Datastore, making the data accessible from Google App Engine or Google Compute Engine using the existing Datastore API. Google Cloud Save is currently in private beta and will be available for general use soon.”
New tools have also been added to Android Studio, “which simplifies the process of adding an App Engine backend to your mobile app,” wrote DeMichillie. The improvements now give Android Studio three built-in App Engine backend module templates, including Java Servlet, Java Endpoints and an App Engine backend with Google Cloud Messaging, he wrote. “Since this functionality is powered by the open-source App Engine plug-in for Gradle, you can use the same build configuration for both your app and your backend across IDE, CLI and Continuous Integration environments.”
Google Cloud Platform Unveils New Developer Tools, Services
The tech giant is often adding new services and tweaking its Google Cloud Platform for users and developers.
Earlier this month, Google announced that it is experimenting with a new method to drastically speed up the transfer of large data sets on the company’s cloud storage platform. The process, called Online Cloud Import for Google Cloud Storage, is now in limited preview mode for selected customers to use and test as the system is refined. Interested customers can sign up to participate in the limited preview. Users can configure their desired synchronization by employing a set of advanced filters based on file-creation dates, filename filters and the times of day they prefer to import data. Once the data is synchronized, users will receive an email notification with complete details about the process.
In April 2014, Google announced the availability of its Google Cloud Platform services to the Asia-Pacific region as it moves to expand the reach of its cloud services to more developers around the world. The new service availability means that the Google Cloud Platform Website and the developer console will also be available in Japanese and Traditional Chinese.
Earlier in April, Google unveiled new lower pricing for Google Cloud Platform customers through “Sustained Use Discounts” that the company made available to users who run large projects on virtual machines. Under the new pricing scheme, users will save more as they use more virtual machines in the Google Cloud.
In March 2014, the company introduced a new Google APIs Client Library for .NET and improved documentation for using third-party Puppet, Chef, Salt and Ansible configuration-management tools, according to an eWEEK report. The new Google APIs Client Library for .NET is an open-source effort, hosted at NuGet, that lets developers building on the Microsoft .NET Framework integrate their desktop or Windows Phone applications with Google’s services. The library includes more than 50 Google APIs for Windows developers.
Also released in March was a new Google paper, “Compute Engine Management with Puppet, Chef, Salt, and Ansible,” which provides information for Google Cloud Platform developers who want to use configuration-management tools such as those from Puppet, Salt, Chef and Ansible.
In October 2013, Google replaced its old Google API Console with a new, expanded and redesigned Google Cloud Console to help developers organize and use the more than 60 APIs offered by Google.
Also in October, the company released several technical papers to help cloud developers learn more about the development tools it offers through its Google Compute Engine services. The papers, including “Overview of Google Compute Engine for Cloud Developers” and “Building High Availability Applications on Google Compute Engine,” offer insights and details about how the platform can be used and developed for business applications.