Close
  • Latest News
  • Artificial Intelligence
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Artificial Intelligence
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Database
    • Database

    5 Guidelines for Ensuring Proper Data Preparation

    By
    Darryl K. Taft
    -
    September 12, 2016
    Share
    Facebook
    Twitter
    Linkedin

      PrevNext

      15 Guidelines for Ensuring Proper Data Preparation

      1 - 5 Guidelines for Ensuring Proper Data Preparation

      Organizations looking to analyze big data for deep insights need data that is clean, organized, detailed and easily understood. What’s more, data prep is crucial throughout the workflow.

      2Data Preparation Needs to Be More Than Just Cleansing

      2 - Data Preparation Needs to Be More Than Just Cleansing

      Cleaning data is a small part of the battle, and even a clean data set may be not ready for analysis. It takes strategy and experience to start with data in its original forms and reshape or process it to work well for analysis. Typically, the data that leads to insights requires some interpretation and transformation of the original data. Big data analytics involves a different process, data discovery, in which data is pulled from multiple sources, then sifting through it until useable data can be found.

      3Preparation Must Be Integral to the Entire Analytic Workflow

      3 - Preparation Must Be Integral to the Entire Analytic Workflow

      Data prep isn’t just a one-and-done, up-front process. The word “preparation” may imply that the data prep process takes place as an early step. It’s important to understand the role of data preparation in the larger analytic workflow. In big data discovery, data preparation may take place at any point in an iterative, ongoing data discovery process. After analysis, the data discovery may reveal flaws in the data or the need to add new data, revealing new requirements for how the data should be shaped, interpreted, enhanced or cleansed.

      4Ensure Flexible Data Organization

      4 - Ensure Flexible Data Organization

      In practice, data preparation involves several subtasks. The most common ones are data cleansing and data transformation. Yet there are other subtasks, such as looking inside the data for other data of interest. To find deeper diagnostic insights, big data analytics needs to go beyond the standard slicing and dicing of information to find hidden trends. This requires organizing the data during the data preparation phase in different ways than the typical dimensions and metrics. Doing so makes it easy to organize data for more advanced analytics and helps drive general analytical use cases, such as clickstream and time-series analysis, as well as specific ones, such as fraud, preventive maintenance, buying patterns and more.

      5Create Rich Data Sets

      5 - Create Rich Data Sets

      Enriching data by joining it to other data sets, whether from internal corporate systems or external, publicly available data sets, is another way to discover the data hidden in the apparent data. This is common in customer analytics. While transactional history of who bought what and when is a great baseline for analysis, today’s organizations need deeper insights from their transactional data. For example, you might want to ask, what was the impact of weather, seasonality, customer gender, income or education level on sales? Business stakeholders can only find these insights through data enrichment or embellishing.

      6Deploy a Highly Collaborative Environment With Full Governance

      6 - Deploy a Highly Collaborative Environment With Full Governance

      An analysis may need a curated, well-prepared data set. Related analyses may require new datasets that further shape the data. This leads to analysts collaborating, sharing and building on each other’s prepared data sets, helping them save time and increasing their productivity. As such, organizations need a highly collaborative environment for effective data preparation pipelines and deeper analytic insights. Sharing both analytic data sets and content enables analysts to cast wide question nets while ensuring data and results are in line with corporate accuracy standards and compliance requirements.

      PrevNext
      Get the Free Newsletter!
      Subscribe to Daily Tech Insider for top news, trends & analysis
      This email address is invalid.
      Get the Free Newsletter!
      Subscribe to Daily Tech Insider for top news, trends & analysis
      This email address is invalid.

      MOST POPULAR ARTICLES

      Latest News

      Zeus Kerravala on Networking: Multicloud, 5G, and...

      James Maguire - December 16, 2022 0
      I spoke with Zeus Kerravala, industry analyst at ZK Research, about the rapid changes in enterprise networking, as tech advances and digital transformation prompt...
      Read more
      Applications

      Datadog President Amit Agarwal on Trends in...

      James Maguire - November 11, 2022 0
      I spoke with Amit Agarwal, President of Datadog, about infrastructure observability, from current trends to key challenges to the future of this rapidly growing...
      Read more
      Applications

      Kyndryl’s Nicolas Sekkaki on Handling AI and...

      James Maguire - November 9, 2022 0
      I spoke with Nicolas Sekkaki, Group Practice Leader for Applications, Data and AI at Kyndryl, about how companies can boost both their AI and...
      Read more
      Cloud

      IGEL CEO Jed Ayres on Edge and...

      James Maguire - June 14, 2022 0
      I spoke with Jed Ayres, CEO of IGEL, about the endpoint sector, and an open source OS for the cloud; we also spoke about...
      Read more
      Careers

      SThree’s Sunny Ackerman on Tech Hiring Trends

      James Maguire - June 9, 2022 0
      I spoke with Sunny Ackerman, President/Americas for tech recruiter SThree, about the tight labor market in the tech sector, and much needed efforts to...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2022 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×