Close
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Cloud
    • Cloud
    • Cybersecurity
    • IT Management
    • Networking

    Five Benefits of Data Endpoint Visibility

    By
    eWEEK EDITORS
    -
    November 11, 2020
    Share
    Facebook
    Twitter
    Linkedin
      eWEEK.logo.DataPoints-blue.border2020

      As teams worldwide embrace cloud-native architectures–replacing waterfall releases with CI/CD, monolith applications with multiple layers of microservices, and singular databases with data meshes–real-time visibility across these layers and their communication patterns becomes critical for management, troubleshooting and assurance. 

      While there are many visibility tools on the market, they mostly operate on the application and infrastructure layer and miss the mark on providing detailed visibility into data endpoints (databases, pipelines, data warehouses, etc.).  Various data-endpoint performance and usage metrics remain difficult to track and make it challenging to answer commonplace questions, such as:

      • Which services are responsible for the lion’s share of request execution time?
      • How does the number of requests from each accessing service change over time, and can we identify bottlenecks?
      • Which users are exhibiting suspicious data read patterns?

      Real-time visibility into data endpoints lets teams quickly pinpoint what is slow, what is unexpected and what is broken. In this eWEEK Data Points article, using industry information from Manav Mital, CEO of Cyral, we discuss several examples and benefits of this visibility.

      Data Point No. 1: SaaS BI tool performance monitoring

      Many BI tools such as Looker access the database using a single service user that is shared by the requests coming from all users of the tool. When a bad request from any single user takes a long time to run and affects other workloads running on the data endpoint, it makes it difficult to attribute requests to the individuals responsible for executing them.

      Enriching data endpoint visibility with granular end-user information makes it possible to monitor long-running requests and to trace them back to specific individuals for prompt alerting and quick remediation.

      Data Point No. 2: DBaaS credits usage monitoring

      Modern DBaaS such as Snowflake and BigQuery charge customers based on utilization, which is directly impacted by the cumulative execution time spent by users of the service. The ability to track execution times on a daily / weekly basis for high cumulative usage individuals and to drill down on the reasons for their high usage makes it easy for account and billing administrators to forecast service costs and take remediation steps to keep the costs down.

      Data Point No. 3: ETL throughput issues diagnosing

      ETL (extract, transform, load) job throughput and performance are affected by a number of factors, such as the connection pool size, ingest batch size and commit frequency. Data endpoints usually lack necessary information to reason about a badly performing ETL job because they do not track these metrics.

      Improving data endpoint visibility with granular metrics such as these makes it easy for DevOps and SRE (site reliability engineering) teams to monitor their ETL jobs and diagnose issues due to inadvertent changes that affect their performance.

      Data Point No. 4: Trickle data exfiltration detection

      Trickle exfiltration involves sophisticated mechanisms to exfiltrate data from an endpoint. The objective of an attacker is to stay “under the radar” of network and security monitoring tools by adopting a low and slow approach to exfiltration.

      All trickle exfiltration attacks rely on what are called point requests (fetching a small set of specific rows), range requests (fetching a small range of rows) and offset requests (fetching a small set of rows from a different offset each time).

      Tracking metrics such as the rate of requests and the number of data records read over time and correlating with other data activity in that time frame adds extra visibility making it easier to detect when an attacker or an insider is actively involved in theft of sensitive data.

      Data Point No. 5: Abnormal service behavior detection

      Theft and abuse of credentials meant for applications such as ETL jobs are often hard to detect because data endpoints do not have the means to distinguish regular applications from a rogue application. Being able to detect changes in behavior, such as when a presumed ETL job ends up writing to a data endpoint from where it typically reads, allows DevOps and security teams to identify whether their data endpoints’ credentials have been compromised.

      If you have a suggestion for an eWEEK Data Points article, email cpreimesberger@eweek.com.

      eWEEK EDITORS
      eWeek editors publish top thought leaders and leading experts in emerging technology across a wide variety of Enterprise B2B sectors. Our focus is providing actionable information for today’s technology decision makers.

      MOST POPULAR ARTICLES

      Big Data and Analytics

      Alteryx’s Suresh Vittal on the Democratization of...

      James Maguire - May 31, 2022 0
      I spoke with Suresh Vittal, Chief Product Officer at Alteryx, about the industry mega-shift toward making data analytics tools accessible to a company’s complete...
      Read more
      Cybersecurity

      Visa’s Michael Jabbara on Cybersecurity and Digital...

      James Maguire - May 17, 2022 0
      I spoke with Michael Jabbara, VP and Global Head of Fraud Services at Visa, about the cybersecurity technology used to ensure the safe transfer...
      Read more
      Applications

      Cisco’s Thimaya Subaiya on Customer Experience in...

      James Maguire - May 10, 2022 0
      I spoke with Thimaya Subaiya, SVP and GM of Global Customer Experience at Cisco, about the factors that create good customer experience – and...
      Read more
      Big Data and Analytics

      GoodData CEO Roman Stanek on Business Intelligence...

      James Maguire - May 4, 2022 0
      I spoke with Roman Stanek, CEO of GoodData, about business intelligence, data as a service, and the frustration that many executives have with data...
      Read more
      Cloud

      Yotascale CEO Asim Razzaq on Controlling Multicloud...

      James Maguire - May 5, 2022 0
      Asim Razzaq, CEO of Yotascale, provides guidance on understanding—and containing—the complex cost structure of multicloud computing. Among the topics we covered:  As you survey the...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2022 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×