Data Storage: Internet Archive Gets a Place in the Sun (Portable Data Center)

 
 
By Chris Preimesberger  |  Posted 2009-03-26 Email Print this article Print
 
 
 
 
 
 
 
 
The Internet Archive, one of the fastest-growing digital libraries in the world, has migrated its massive amount of content into a new Sun Microsystems-built portable data center loaded with 60 Sun X4500 Thumper arrays that each have 48TB of storage capacity. Sun staged a launch event at its Santa Clara, Calif., headquarters on March 25. "It's amazing to think that the whole Web collection, which is about 2PB compressed and from 4PB to 5PB uncompressed, can live in a 20-foot-by-8-foot-by-8-foot shipping container, which, from our standpoint, is a computer," Brewster Kahle, digital librarian and founder of the Internet Archive, told eWEEK. The archive, which employs the equivalent of only three system administrators, goes back to 1996 and stores more than 150 billion Web pages, Kahle said. It is accessed 500 times per second. Archive.org also houses the Wayback Machine, 1 million books, 100,000 movies and about 200,000 audio recordings, Kahle said. "It is a full-on library. This technology we see as another step toward a manageable system for dealing with enormous amounts of information safely."
 
 
 

Internet Archive Gets a Place in the Sun (Portable Data Center)

 
Internet Archive Gets a Place in the Sun (Portable Data Center)
 
 
 
 
 
Chris Preimesberger Chris Preimesberger was named Editor-in-Chief of Features & Analysis at eWEEK in November 2011. Previously he served eWEEK as Senior Writer, covering a range of IT sectors that include data center systems, cloud computing, storage, virtualization, green IT, e-discovery and IT governance. His blog, Storage Station, is considered a go-to information source. Chris won a national Folio Award for magazine writing in November 2011 for a cover story on Salesforce.com and CEO-founder Marc Benioff, and he has served as a judge for the SIIA Codie Awards since 2005. In previous IT journalism, Chris was a founding editor of both IT Manager's Journal and DevX.com and was managing editor of Software Development magazine. His diverse resume also includes: sportswriter for the Los Angeles Daily News, covering NCAA and NBA basketball, television critic for the Palo Alto Times Tribune, and Sports Information Director at Stanford University. He has served as a correspondent for The Associated Press, covering Stanford and NCAA tournament basketball, since 1983. He has covered a number of major events, including the 1984 Democratic National Convention, a Presidential press conference at the White House in 1993, the Emmy Awards (three times), two Rose Bowls, the Fiesta Bowl, several NCAA men's and women's basketball tournaments, a Formula One Grand Prix auto race, a heavyweight boxing championship bout (Ali vs. Spinks, 1978), and the 1985 Super Bowl. A 1975 graduate of Pepperdine University in Malibu, Calif., Chris has won more than a dozen regional and national awards for his work. He and his wife, Rebecca, have four children and reside in Redwood City, Calif.Follow on Twitter: editingwhiz
 
 
 
 
 
 

Submit a Comment

Loading Comments...
 
Manage your Newsletters: Login   Register My Newsletters























 
 
 
 
 
 
 
 
 
Thanks for your registration, follow us on our social networks to keep up-to-date
Rocket Fuel