One-Third of BI Pros Spend Up to 90% of Time Cleaning Data
An Xplenty survey shows that about one-third of BI professionals spend between 50 percent and 90 percent of their time cleaning data so it can be analyzed.A recent survey commissioned by data integration platform provider Xplenty indicates that nearly one-third of business intelligence (BI) professionals are little more than “data janitors,” as they spend a majority of their time cleaning raw data for analytics. The study focused on several areas of the Extract, Transform and Load (ETL) process, including preferences for on-premises or cloud-based solutions, perceived challenges, and the amount of time spent on ETL. Ninety-seven percent of those surveyed said ETL was critical for their business intelligence efforts. Moreover, more than half (51 percent) of BI professionals polled said that they currently leverage on-premises ETL solutions, versus 49 percent using cloud-based tools. However, of those who said they presently use on-premises ETL tools, 51 percent said that they were “strongly considering” moving all ETL processes to the cloud. ETL is the process of extracting data from homogeneous or heterogeneous data sources, transforming the data for storage in the proper format or structure for querying and analysis purposes, and loading the data into the final target – such as a database, data store, data mart, or data warehouse.
“While many organizations still rely heavily on existing on-premises IT for ETL, the desire to shift to a more cloud-based model has never been stronger,” said Yaniv Mor, CEO and co-founder of Xplenty, in a statement. “Cloud ETL offers a host of benefits over on-premises, from increased agility in resource deployment to reduced costs. As such, the cloud is an increasingly attractive option from both a performance and operational perspective.”