Wal-Mart Plans for Its 4PB Data Warehouse

When the worlds largest retailer struggles with a database issue, the numbers can be a bit daunting. Wal-Marts data warehouse, for example, is larger than four petabytes. Thats more than 4,096TB, give or take a few million bits.

The chain has more than 6,000 stores, with some having almost a half-million SKUs each. You think your Excel spreadsheets are bad? Wal-Marts database tables have literally 100 billion rows. The retailers POS systems have to ring up some 276 million items, a day.

This peek into the IT operations of this $345 billion retail empire comes courtesy of a phone interview with Wal-Mart Chief Technology Officer Nancy Stewart. The occasion: Wal-Mart wanted to talk up a recent purchase of HP Neoview systems.

Although HP and Wal-Mart issued the statement on Aug. 1, the systems have been in place for months, having gone into full production in May, Stewart said. Wal-Mart rarely agrees to news releases for purchases, let alone interviews. Why this special treatment for HP?

"We delayed this announcement for several months. This announcement has not come on a whim," she said. The HP system "has very strong high-availability characteristics. The thing that did it for me personally in terms of the relationship is that it is an extremely high availability system and it requires very little support."

HPs servers, which will take their place along with hardware from IBM, EMC and Teradata, were chosen because of how they performed within Wal-Marts very high-volume, high-stress environment. "We wanted our relationship to see if we could max out high performance characteristics," Stewart said. "What a lot of the folks we have dealt with do is they will parse the queries. Here at Wal-Mart, we dont batch the queries. We process those records in real time."

The Wal-Mart executive said she was surprised with HPs performance. "We are very very pleased with where we are today. We have been very very surprised that they have been able to deliver within this timeframe," Stewart said, adding that she also applauds their attitude. "They would just take every challenge. They kind of delighted in the opportunity."

Resource Library:

Report: Wal-Mart RFID has gone quiet, not inactive. Click here to read more.

Although Stewart wouldnt get into details about exactly what HPs servers will be doing for Wal-Mart, she did say that they would be involved with RetailLink—the chains supply chain system for suppliers and customers—with the goal of improving product information access.

"What we want is to be able to better present wherever those products are, in the right store in a community. We need to make decisions much more quickly."

Retail Center Editor Evan Schuman can be reached at Evan_Schuman@ziffdavis.com.

Check out eWEEK.coms for the latest news, reviews and analysis on enterprise and small business storage hardware and software.