Google Making It Easier to Transfer Huge Datasets on the Cloud
Google's new Online Cloud Import services are now in preview mode, but could later be available on a widespread basis to help enterprises move their large datasets around on the cloud.Google is experimenting with a new method to drastically speed up the transfer of large datasets on the company's cloud storage platform. The process, called Online Cloud Import for Google Cloud Storage, is now in limited preview mode for selected customers to use and test as the system is refined. The new data importing tool was announced by Lamia Youseff, a Google product manager, in a June 19 post on the Google Cloud Platform Blog. "Our customers tell us that importing multi-terabyte datasets, such as log files and media libraries, from other cloud-based 3rd party storage providers can be slow and expensive. Today, we're introducing a limited preview of Online Cloud Import for Google Cloud Storage which makes it faster, easier and cheaper to import online data to your Cloud Storage buckets (standard or regional in U.S. or Europe) using Google's high performance network." Interested customers can sign up to participate in the limited preview, wrote Youseff. "Online Cloud Import provides a number of options that make data transfers and synchronization easier. Not only can you create a one-time backup/transfer of your data to your Cloud Storage bucket, but you can also set a periodic scheduled synchronization of your 3rd party storage to Google Cloud Storage." Users can also configure their desired synchronization using a set of advanced filters based on file creation dates, filename filters and the times of day you prefer to import data, wrote Youseff. Once the data is synchronized, users will receive an email notification with complete details about the process.
The Online Cloud Import feature complements both gsutil and Cloud Storage Offline Disk Import, she wrote. "Cloud Storage Offline Disk Import is suitable if you have hundreds of terabytes of offline data—disk-upload centers are available in Switzerland, Japan, India and the United States. If you'd like command-line control, and are dealing with less than 10TB, we suggest using gsutil (now with rsync) to transfer your data."