eWorld is an IBM business partner, so Hansen also proposed IBMs DB2 Enterprise Edition as its database and DB2 Warehouse Manager for the management layer. Hansen framed the problem as understanding "where the data resides" and what the users wanted to see on their computer screens. His team and the states steering committee first considered what sort of queries users would ask. Then he consulted with the FAMIS development team to pinpoint where that data existed."The challenge is that its so unstructured," Hansen said. "Theres a lot of cleansing and transformation that needs to be done to put the data into tables and to make sense." At the front end, eWorld used IBMs WebSphere Application Server to develop a custom-made J2EE (Java 2 Platform, Enterprise Edition) financial analysis program for the state. More important, Hansens team met with Nakamura, Sasaki and other state officials weekly to keep a tight grip on how the application would function. Click here to read about how IBM beefed up its WebSphere App Server Platform. Sasaki coordinated the state end, but his bosses gave him strong authority "to reverse scope creep," he said. "Whenever anyone said, This would be nice, we said no. We just wanted to get something out the door." eWorld also encountered a few infrastructure obstacles for which open source saved the day. WebSphere, for example, ran on an Intel Corp. server because at that point it was not compatible with the zLinux operating system used by the mainframe. But because the various flavors of Linux cooperate so easily, Hansen said he could seamlessly port configurations and files from one part of the system to another. Hawaiis DB2 system went live in December 2002. Its first users were 150 accounting employees, working mostly in the Department of Accounting and General Services. Today, Warehouse Manager on a daily basis captures state financial transactions (which average 7,500 per day but can hit 25,000 on busy days, Nakamura said) and stores them in the DB2 data mart for future use. The DB2 system sits on 10 percent of the states mainframe, parceled out specifically for the Linux system. Each year of transactions occupies about 2.1GB of storage space. FAMIS could hold only three years worth of data, but Nakamura hopes to store 10 years worth of data on DB2 as more funding becomes available. The new database has proved so popular that the state began an expansion and upgrade just last month. eWorld upgraded all three system components to the latest versions available from IBM (Version 8 for DB2 Enterprise Edition and DB2 Warehouse Manager, Version 5 for the WebSphere server) and installed the latest version of SuSE Linux. The company also began tests to increase user capacity to about 500 people in more departments. Nakamura, meanwhile, said he has already told state workers to generate a wish list of new features and functions they want to add to the system as funding becomes available. "We didnt get all the funding we needed at one time to do all the things we can," he said. "We see this as a living project." Matt Kelly is a free-lance writer in Somerville, Mass. He can be reached at firstname.lastname@example.org. Check out eWEEK.coms for the latest open-source news, reviews and analysis.
"That process was very collaborative," Hansen said. Ultimately, eWorld developed a series of Warehouse Manager processes, extracted all the necessary data from the FAMIS system, and used those processes to cleanse the data and correlate it into tables stored in the DB2 database.