Web 2.0: How High-Volume eBay Manages Its Storage

By Chris Preimesberger  |  Posted 2006-10-27 Print this article Print

The ultrapopular auction/sales Web site continues its exponential growth and finds itself adding 10 terabytes of new storage every week. That's a lot of data.

eBay, like Xerox and Google, is fast becoming its own generic verb for what it does ("Oh, just eBay it"). And when a company itself becomes the name for what it does, then a certain level of success has been reached. Make that a very high level of success. Among Web 2.0 companies, San Jose, Calif.-based eBay is up there with Google, Amazon, Yahoo, eHarmony, Digg.com, and social networking sites MySpace.com and FaceBook.com as far as traffic, popularity and profitability are concerned. Some of the facts and figures -- according to eBay itself -- about the worlds largest auction business and most popular commercial Web site are downright staggering:
  • The site averages more than 1 billion page views per day.
  • Users trade about $1,700 worth of goods on the site every second.
  • 26 billion SQL queries per day.
  • A vehicle sells every minute.
  • A motor part or accessory sells every second.
  • Diamond jewelry sells every 2 minutes.
  • The site currently posts about 600 million listings per quarter and about 204 million registered users.
  • This one, in particular, is striking: 1.3 million people make all or part of their living selling on eBay. To put this into a little perspective, FDRs two largest New Deal jobs programs, the Civilian Conservation Corps and the Civil Works Administration, employed a total of 6.5 million workers in the 1930s. eBay is handling all those transactions, Web site page views and money changing hands on a near-no-latency, 24/7, international basis. The sites availability has been charted at 99.94 percent per day (a hiccup of about 50 seconds per day). When it was charted in June 1999, the site was latent an average of 43 minutes per day. How eBay got to this level of technical efficiency and success is a long story. What we can do is offer an overview about how the company approaches its storage strategy—something that the company hasnt talked about with the media before. Not many Web-based businesses have run into the kind of traffic and server-availability issues that eBay has experienced. "Our growth has just been exponential for 11 years," eBay Research Labs Distinguished Engineer Paul Strong told eWEEK. "And since our job is to provide available, efficient, low-latency, 24/7 performance, we know we have a difficult job to do every day to keep the site running as perfectly as we need it to run." Next Page: 2 petabytes daily.

    Chris Preimesberger Chris Preimesberger was named Editor-in-Chief of Features & Analysis at eWEEK in November 2011. Previously he served eWEEK as Senior Writer, covering a range of IT sectors that include data center systems, cloud computing, storage, virtualization, green IT, e-discovery and IT governance. His blog, Storage Station, is considered a go-to information source. Chris won a national Folio Award for magazine writing in November 2011 for a cover story on Salesforce.com and CEO-founder Marc Benioff, and he has served as a judge for the SIIA Codie Awards since 2005. In previous IT journalism, Chris was a founding editor of both IT Manager's Journal and DevX.com and was managing editor of Software Development magazine. His diverse resume also includes: sportswriter for the Los Angeles Daily News, covering NCAA and NBA basketball, television critic for the Palo Alto Times Tribune, and Sports Information Director at Stanford University. He has served as a correspondent for The Associated Press, covering Stanford and NCAA tournament basketball, since 1983. He has covered a number of major events, including the 1984 Democratic National Convention, a Presidential press conference at the White House in 1993, the Emmy Awards (three times), two Rose Bowls, the Fiesta Bowl, several NCAA men's and women's basketball tournaments, a Formula One Grand Prix auto race, a heavyweight boxing championship bout (Ali vs. Spinks, 1978), and the 1985 Super Bowl. A 1975 graduate of Pepperdine University in Malibu, Calif., Chris has won more than a dozen regional and national awards for his work. He and his wife, Rebecca, have four children and reside in Redwood City, Calif.Follow on Twitter: editingwhiz

    Submit a Comment

    Loading Comments...
    Manage your Newsletters: Login   Register My Newsletters

    Rocket Fuel