Data Management: Getting Clean

 
 
By eweek  |  Posted 2004-08-24 Email Print this article Print
 
 
 
 
 
 
 

Sophisticated business intelligence tools give executives greater "visibility" into a company's operations than ever before, but they're useless—and even self-defeating— if the underlying data's not clean. Here's a guide for washing

CHALLENGE
Keeping your companys data clean isnt a set-it-and-forget-it project.

As long as there has been data, there have been errors. But at least in the good old days (way back in the 1980s, say), there was less data to manage. "The main source of customer data was basically the address to ship an item and an address to bill the customer," says Paul Kirby, a research director at AMR Research Inc. Today, data is considerably more complex. In addition to keeping track of vendors, suppliers, inventory and financial records, companies now track customers buying habits, preferences and a host of other bits of data that make marketers salivate.

All of that drooling, of course, presumes that the numbers are accurate. But what if theyre not? This May, Gartner Inc. released a startling statistic: More than 25 percent of critical data used in large corporations is flawed, due to human data-entry error, customer profile changes (such as a change of address) and a lack of proper corporate data standards. The result: soiled statistics, fallacious forecasting and sagging sales. Whats more, the research firm says that through 2007 "more than 50 percent of data-warehouse projects will experience limited acceptance, if not outright failure, because they will not proactively address data-quality issues."

In other words, that major data-integration project that you championed for months—and on which you staked your reputation—could ultimately fail, damaging your credibility and giving upper management one more reason to blame the IT department.

While it may seem ironic that companies spend far more time and money analyzing data than ensuring its accurate, Gartner analyst Ted Friedman isnt surprised. "People become enamored with data-analysis tools and make assumptions that the data is readily available and in good shape," he says. "They gloss over the data issues, and thats a recipe for failure."

Gartner isnt the only research company tracking the data-quality problem. The Data Warehousing Institute estimates that companies lose more than $600 billion every year thanks to poor data. Forty billion of that can be attributed to the consumer packaged goods industry and retail supply chain alone, says Kosin Huang, a senior analyst at The Yankee Group. According to a recent study by Forrester Research Inc., 37 percent of companies cite duplicate and overlapping files as significant data-management problems.

Click here to read how Oracles move to a monthly patch schedule poses problems for users with recent security flaws.
Dirty data can damage every aspect of your business. On the customer-service side, bad and out-of-date information can mean failed marketing promotions and angry customers. In the supply chain, poor product data can cause production bottlenecks and slow down delivery orders to retailers. And if youre a company that has to meet with, say, Wal-Mart Store Inc.s RFID mandate, flawed data increases the likelihood of glitches in that rollout, too. "Sure, you can track cases and different pallets," says Huang, "but you may be tracking the wrong thing."

The benefits of squeaky clean data are numerous (and, in many ways, obvious): Better customer data means improved customer service and a decreased risk of failed marketing promotions, not to mention new opportunities to cross- and up-sell. It also increases the accuracy of forecasting, makes your supply chain more efficient, and helps companies comply with federal regulations such as Sarbanes-Oxley.

"Theres no doubt that a quality-checking process cannot be skimped," says J. Wadsworth, vice president of data services at MarketTouch, an Alpharetta, Ga.-based direct-marketing company. "If youre not doing it, youre throwing money to the wind."

Ask Your Chief Strategist:
  • What is our companys most critical data?

    Ask Your Supply Chain Manager:
  • Does a lack of product data standards cause bottlenecks in our supply chain?

    Tell Your CEO:
  • Improving the quality of our data will boost revenue and create operational efficiencies.

    Check out eWEEK.coms Database Center at http://database.eweek.com for the latest database news, reviews and analysis.

    Be sure to add our eWEEK.com database news feed to your RSS newsreader or My Yahoo page Next Page: Getting strategic.



  •  
     
     
     
     
     
     
     
     
     
     

    Submit a Comment

    Loading Comments...

     
    Manage your Newsletters: Login   Register My Newsletters























     
     
     
     
     
     
     
     
     
     
     
    Rocket Fuel