EMC Breaks Out Distributed Deduplication Package

By Chris Preimesberger  |  Posted 2010-05-11 Print this article Print

At its annual conference, EMC reveals data protection software called DD Boost, for Data Domain Boost, which the company claims is the first such package to optimize and accelerate disk-based backup integrated with deduplication storage.

EMC execs must love the month of May, when the company can host and feed scores of partners and customers, do some razzle-dazzling of potential buyers, and share news of new products and services at its EMC World conference.

Usually, the event is staged in a resort-like place like Orlando, Fla. This year, the world's largest independent storage maker, based in Hopkinton, Mass., elected to stay close to home in Boston. Nothing wrong with that, but anybody wishing to soak up some near-tropical sunshine will simply have to wait until another day.

EMC continues to draw on 2009's $2.2 billion Data Domain acquisition for new purposes.

In April, EMC launched a Data Domain global deduplication array that is capable of backing up 12.8TB of data per hour (a rate of 3.5G bps), has a top usable capacity of 280TB and can handle up to 270 concurrent write streams.

On May 11, EMC revealed something called DD Boost (for Data Domain Boost), data protection software that the company claims is the first such package to "optimize and accelerate" disk-based backup integrated with deduplication storage.

Data deduplication eliminates redundant data from a disk storage device in order to lower storage space requirements, which in turn lowers data center power and cooling costs and lessens the amount of carbon dioxide produced in generating power to run the hardware.

DD Boost's secret sauce is that it distributes the deduplication process, identifying data segments in-line as they arrive in a Data Domain storage system. It analyzes the segments to determine which blocks are new, then compresses and forwards only the unique segments to the storage array.

This pre-editing of data blocks speeds throughput in the overall backup load and can reduce local network traffic by a large margin-possibly as high as 80 to 95 percent-because redundant data segments do not enter the array in the first place.

A side benefit of the DD Boost process is that it reduces workload strain on the overall backup process, EMC said.

DD Boost will work with non-EMC backup products, such as Symantec NetBackup and Backup Exec, and is available now, EMC said.

Ironically, the same product for EMC's own NetWorker backup package won't be ready for prime time until the second half of 2010. Go here for more information.

Chris Preimesberger Chris Preimesberger was named Editor-in-Chief of Features & Analysis at eWEEK in November 2011. Previously he served eWEEK as Senior Writer, covering a range of IT sectors that include data center systems, cloud computing, storage, virtualization, green IT, e-discovery and IT governance. His blog, Storage Station, is considered a go-to information source. Chris won a national Folio Award for magazine writing in November 2011 for a cover story on Salesforce.com and CEO-founder Marc Benioff, and he has served as a judge for the SIIA Codie Awards since 2005. In previous IT journalism, Chris was a founding editor of both IT Manager's Journal and DevX.com and was managing editor of Software Development magazine. His diverse resume also includes: sportswriter for the Los Angeles Daily News, covering NCAA and NBA basketball, television critic for the Palo Alto Times Tribune, and Sports Information Director at Stanford University. He has served as a correspondent for The Associated Press, covering Stanford and NCAA tournament basketball, since 1983. He has covered a number of major events, including the 1984 Democratic National Convention, a Presidential press conference at the White House in 1993, the Emmy Awards (three times), two Rose Bowls, the Fiesta Bowl, several NCAA men's and women's basketball tournaments, a Formula One Grand Prix auto race, a heavyweight boxing championship bout (Ali vs. Spinks, 1978), and the 1985 Super Bowl. A 1975 graduate of Pepperdine University in Malibu, Calif., Chris has won more than a dozen regional and national awards for his work. He and his wife, Rebecca, have four children and reside in Redwood City, Calif.Follow on Twitter: editingwhiz

Submit a Comment

Loading Comments...
Manage your Newsletters: Login   Register My Newsletters

Rocket Fuel