Data Storage, Data Backup and Storage Virtualization - eWeek

Data Storage, Data Backup and Storage Virtualization: Internet Archive Gets a Place in the Sun (Portable Data Center)


Share

The Internet Archive, one of the fastest-growing digital libraries in the world, has migrated its massive amount of content into a new Sun Microsystems-built portable data center loaded with 60 Sun X4500 Thumper arrays that each have 48TB of storage capacity. Sun staged a launch event at its Santa Clara, Calif., headquarters on March 25.

"It's amazing to think that the whole Web collection, which is about 2PB compressed and from 4PB to 5PB uncompressed, can live in a 20-foot-by-8-foot-by-8-foot shipping container, which, from our standpoint, is a computer," Brewster Kahle, digital librarian and founder of the Internet Archive, told eWEEK.

The archive, which employs the equivalent of only three system administrators, goes back to 1996 and stores more than 150 billion Web pages, Kahle said. It is accessed 500 times per second. Archive.org also houses the Wayback Machine, 1 million books, 100,000 movies and about 200,000 audio recordings, Kahle said. "It is a full-on library. This technology we see as another step toward a manageable system for dealing with enormous amounts of information safely."
 
  • Brewster Kahle, founder of the Internet Archive and a longtime digital librarian, demonstrates how big he thinks the Internet is at the launch event of the archive project in Santa Clara, Calif.
  • The Internet Archive is powered by 60 Sun X4500 "Thumper" storage arrays, which are industrial-strength capacity managers. Each Thumper (a rack of them is shown in this photo) holds 48 disk drives, each 1TB in capacity.
  • Sun engineer Jud Cooley—aptly named because he's one of the company's experts on data center power and cooling issues and is a representative to the Green Grid consortium—poses with one of his special projects.
  • A pair of signboards at the launch illustrate how the Sun portable modular data centers can be deployed. They can be transported by ship, train, truck, airplane or helicopter to just about anywhere in the world.
  • Sun business development specialist Rodger Lindquist shows off the innards of the modular data center that houses the Internet Archive.
  • The Internet Archive data center is housed in a quiet section of the parklike Sun campus in Santa Clara, Calif.
  • For years before Sun moved its headquarters to the location in the late 1990s, the Santa Clara campus was run by the state of California as the Agnews Hospital.
xڽZ[s۸~~d_Bv8v|5mݼh@S $EYԅv["\p7<v7 ; !_\GlHádc.!vfjC⺝7o~:7-/N# bThL 2v(Jhx\zv;Y@Du4:AXIhqۉH;dMyF DZ:$1(*v.L{oj(H6j;^"ٌT R)S,j;(sbҍCh֫RDyB:m"X@9wUAgs-GUڽas"W9XsBN B3&5̣@J+9\1cFΠd$39 vAk6I^}x#4AA:pCiCəpҋǿ&O- tL$V2XY0q"+"f|JLyI##<昏J4 DMql..>? ҅6!keUMLf<=bS* Re%-_zЌn. \GXu"-R#\H.Q;pH.Tu^n1+1 rOf >ijJFh cB/Bi5I,ZeTR'@@$l6lGN# >Ԫ*3aVO vZMZ+^,i螉ijWS{.u &\ێBL\CO)U9z]Y;k$$oL~hZ'Ilm9WlD=,v .qaBc86[j Jg١zԭ z1\ cnm O.C6T㦜 Bאǡ0˞ȯ@I Pk~H䱘cRΙzCŸxā}%7Jk10ti`w=ڣVM4nqnCZQ!.5<OU^ Gઇ߰Ԓ%V\J^HY-?uB XĒ+B{푾R3:fX?p@d> &1CǵkhJh I٢FU40y |8Y#yzR|g&fu,ŔIcw=;;ޒ7}!JitLh2f7.ԓftYm"oYdu͏ $k4xKơd A&G{̺A )V '<5i;_26.IwP \1{ZnmP44,s&gu5zéY88]Z<`ɝzqЙwۑِ|4J1oXt]z-`̃| S-k#)zh~͜X#kB9 +"OB5 ebMkL[}-S}m]Lwy%4u|hėT.T%?GS<N4Az򚰰'_-=V V[51]p8boX_3WeO%,97p_ $_+vFaև#9ͪx5Mq!TJ($cXWJ#q| wVhBX}jd'6R r6Y}be:ɶ]EI@ }a>իkk``VG+aN=r ;LTq?w`tjNG^v\j!9a%]?2TՓ\)C+ÃMH3'@]7Q+[_w*C';M)t jžp&\)8/A¦{|gJ'DTcޖSvO(EE g[xy/_h3ޠrπ.mZf$lS4z5&Vm(e+[;4ƾJ>fo.$ʥFq ܜd5IkeF2(R4gYͻ5 kE| kxlrA"nk ^&6|.oou˟~ iLA;rŢTe~E.OaTNXFREย?~DG[{zrכs7P Lb !0/⡕띜wo>p0Çֳx{}6[&ll|Fh  ۇG&uȒ#7/+ &b4TMqk3[r6Lg9F+c+ɮ3=tC:5jW?2+#s w%ST%aES9,1:c; J"8!\r/~-N?5Y-