Close
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Applications
    • Applications
    • Database
    • Networking
    • Storage

    Metadata Management a Key Part of ETL

    By
    Brian Prince
    -
    June 5, 2008
    Share
    Facebook
    Twitter
    Linkedin

      Performance and connectivity to data sources are key issues when it comes to selecting extract, transform and load tools. However, enterprises should keep an eye towards metadata management before they buy.

      Metadata has more than a tiny role to play in data migration projects. Metadata is, simply put, data about data, and provides context for the information stored in an organization’s databases by answering questions about data formatting as well as how, when and by whom data was collected. ETL tools with metadata capabilities can improve the speed and quality of data integration and support good governance, a number of analysts said.

      “Every ETL tool should maintain clean separation between runtime, code, metadata and models,” said Burton Group analyst Joe Bugajski. “The metadata must include trace relationships for tracking the lineage of any data item from any source to any sink and whatever happened to the data between these two.”

      The metadata environment should be searchable using standard query tools and, preferably, the metadata layer should connect to a MDM (master data management) metadata control system, Bugajski said.

      Many ETL tools have become the traffic cops for enterprise metadata, Forrester Research analyst Rob Karel said. He said the tools offer ability to provide data lineage as well as impact analysis, root cause analysis and the ability to audit data movement and manipulation from source capture points all the way through to data consumption in their BI reports.

      IBM, one of the major players in the market for ETL tools, released Metadata Workbench last year to improve visibility and management during the data integration process. According to research by Forrester, the adoption of data integration tools is increasing, as businesses discover the benefits of using tools instead of hand coding.

      “[ETL tools] provide a metadata-rich environment which allows development teams to understand the impact of changes before they are made to reduce the time required to maintain data integration logic,” said Michael Curry, director of product marketing for information platform and solutions for IBM.

      Overwhelmingly, analysts and others said the main challenges to the typical ETL project have little to do with the tools themselves. An ETL tool cannot help when it comes to getting organization-wide agreement on taxonomies and definitions, said Joy Mundy, an analyst with The Kimball Group.

      Still, ETL tools aid with source control, consistency and system documentation – three less headaches for those involved in the project, Mundy said.

      “An ETL application is incredibly complex. We need a high-level view of the activities with easy ability to drill into the details,” she said. “That way, it’s not all in the head of a developer who might leave the company some day, not to mention, not all in the head of a developer who will forget what he’s done in six months.”

      Brian Prince

      MOST POPULAR ARTICLES

      Android

      Samsung Galaxy XCover Pro: Durability for Tough...

      Chris Preimesberger - December 5, 2020 0
      Have you ever dropped your phone, winced and felt the pain as it hit the sidewalk? Either the screen splintered like a windshield being...
      Read more
      Cloud

      Why Data Security Will Face Even Harsher...

      Chris Preimesberger - December 1, 2020 0
      Who would know more about details of the hacking process than an actual former career hacker? And who wants to understand all they can...
      Read more
      Cybersecurity

      Visa’s Michael Jabbara on Cybersecurity and Digital...

      James Maguire - May 17, 2022 0
      I spoke with Michael Jabbara, VP and Global Head of Fraud Services at Visa, about the cybersecurity technology used to ensure the safe transfer...
      Read more
      Cybersecurity

      How Veritas Is Shining a Light Into...

      eWEEK EDITORS - September 25, 2020 0
      Protecting data has always been one of the most important tasks in all of IT, yet as more companies become data companies at the...
      Read more
      Cloud

      Yotascale CEO Asim Razzaq on Controlling Multicloud...

      James Maguire - May 5, 2022 0
      Asim Razzaq, CEO of Yotascale, provides guidance on understanding—and containing—the complex cost structure of multicloud computing. Among the topics we covered:  As you survey the...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2021 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×