Close
  • Latest News
  • Artificial Intelligence
  • Video
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Subscribe
Logo
  • Latest News
  • Artificial Intelligence
  • Video
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Subscribe
    Home Big Data and Analytics
    • Big Data and Analytics
    • Cloud
    • Database
    • IT Management
    • Storage

    Why Enterprises Waste Billions of Dollars on Data Preparation

    Written by

    Chris Preimesberger
    Published May 17, 2018
    Share
    Facebook
    Twitter
    Linkedin

      eWEEK content and product recommendations are editorially independent. We may make money when you click on links to our partners. Learn More.

      Making sure clean data is flowing inside an enterprise is like keeping a close eye on a motor vehicle’s oil level and quality; you do not want to “run dirty” in either case, because all it can do is gum up the works.

      Clean data can be described as complete, accurate, relevant, up to date, non-corrupted and duplicated only for required backup purposes from a record set, table, object storage volume or database.

      Storing clean data is a critical ingredient for businesses to do accurate analyses, yet many enterprises are still relying on manual and inefficient processes to clean and prepare it. This is the key finding of  a new survey released May 17 from data management toolmaker Trifacta.

      Global Survey About Data Prep Practices

      Trifacta knows this market. Its data preparation platform helps data analysts explore, assess and refine data for analysis and solve the big problems of their business.

      The San Francisco-based company conducted a global data preparation survey of nearly 300 data professionals to identify the challenges hindering organizations’ use of data and analytics.

      Key findings from the survey include:

      • Overreliance on IT resources for data preparation costs organizations billions. Sixty-five percent of IT professionals spend half or more of their time at work on data quality assurance, cleanup or preparation. Based upon Glassdoor salary estimates and IDC’s estimation that there are 18 million IT operations and management professionals globally, organizations are spending approximately $500 billion annually on data preparation.
      • Fifty-nine percent of respondents (both IT professionals and data analysts) believe that the majority of the data analysts in their organization are dependent on IT resources to prepare or access data.
      • Eighty-three percent of analysts believe they would be able to derive increased value from their analysis projects with a decreased dependency on IT.
      • Unnecessary iteration between business users and IT exacerbates the cost of data preparation. Analysts who depend on IT to prepare data often request modifications to their initial requirements, the survey found, likely due to unanticipated findings from the raw data contents. Eighty-two percent of analysts said they regularly go back to IT with new requirements. This includes 11 percent who said they always do this.
      • Excel continues to be the primary tool for data preparation: 37 percent of data analysts and 30 percent of IT professionals use it more than other tools to prepare data. Trifacta predicted that a reliance on manually driven data preparation tools such as Excel will continue to delay data initiatives and deter new insights.
      • Analysts recognize that the time-consuming nature of data preparation is a detriment to their organizations: 58 percent believe that the overall time spent on data QA or data cleansing costs their organization money, more than it delivers value to the organization.
      • Data analysts are also spending too much time preparing data: 92 percent would choose to focus on another analytic activity rather than data preparation, yet 65 percent are spending at least half their time preparing data for analytic use.
      • Critical data is at risk. Even though data privacy concerns abound in today’s business landscape, 74 percent of data analysts confess that their individual computers are one of the top three places they store data, and 56 percent of IT professionals say the same thing.

      Trifacta conducted a global survey of 294 individuals who prepare data—179 IT professionals who prepare data for a group of business users and 115 data analysts who prepare and/or analyze data for themselves. The survey was conducted between April 4 and April 13, 2018.

      For more information, go here.

      Chris Preimesberger
      Chris Preimesberger
      https://www.eweek.com/author/cpreimesberger/
      Chris J. Preimesberger is Editor Emeritus of eWEEK. In his 16 years and more than 5,000 articles at eWEEK, he distinguished himself in reporting and analysis of the business use of new-gen IT in a variety of sectors, including cloud computing, data center systems, storage, edge systems, security and others. In February 2017 and September 2018, Chris was named among the 250 most influential business journalists in the world (https://richtopia.com/inspirational-people/top-250-business-journalists/) by Richtopia, a UK research firm that used analytics to compile the ranking. He has won several national and regional awards for his work, including a 2011 Folio Award for a profile (https://www.eweek.com/cloud/marc-benioff-trend-seer-and-business-socialist/) of Salesforce founder/CEO Marc Benioff--the only time he has entered the competition. Previously, Chris was a founding editor of both IT Manager's Journal and DevX.com and was managing editor of Software Development magazine. He has been a stringer for the Associated Press since 1983 and resides in Silicon Valley.
      Linkedin Twitter

      Get the Free Newsletter!

      Subscribe to Daily Tech Insider for top news, trends & analysis

      Get the Free Newsletter!

      Subscribe to Daily Tech Insider for top news, trends & analysis

      MOST POPULAR ARTICLES

      Artificial Intelligence

      9 Best AI 3D Generators You Need...

      Sam Rinko - June 25, 2024 0
      AI 3D Generators are powerful tools for many different industries. Discover the best AI 3D Generators, and learn which is best for your specific use case.
      Read more
      Cloud

      RingCentral Expands Its Collaboration Platform

      Zeus Kerravala - November 22, 2023 0
      RingCentral adds AI-enabled contact center and hybrid event products to its suite of collaboration services.
      Read more
      Artificial Intelligence

      8 Best AI Data Analytics Software &...

      Aminu Abdullahi - January 18, 2024 0
      Learn the top AI data analytics software to use. Compare AI data analytics solutions & features to make the best choice for your business.
      Read more
      Latest News

      Zeus Kerravala on Networking: Multicloud, 5G, and...

      James Maguire - December 16, 2022 0
      I spoke with Zeus Kerravala, industry analyst at ZK Research, about the rapid changes in enterprise networking, as tech advances and digital transformation prompt...
      Read more
      Video

      Datadog President Amit Agarwal on Trends in...

      James Maguire - November 11, 2022 0
      I spoke with Amit Agarwal, President of Datadog, about infrastructure observability, from current trends to key challenges to the future of this rapidly growing...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2024 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.