Close
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Big Data and Analytics
    • Big Data and Analytics

    IT Turning to the Cloud to Handle Growing Big Data Demands

    By
    Dennis McCafferty
    -
    September 11, 2018
    Share
    Facebook
    Twitter
    Linkedin

      PrevNext

      1IT Turning to the Cloud to Handle Growing Big Data Demands

      IT Turning to the Cloud to Handle Growing Big Data Demands

      Intro: Organizations are drowning in big data, according to a recent survey from Qubole. The resulting report, titled “An In-Depth Look at Big Data Trends and Challenges,” reveals that the number of enterprises with more than 100 terabytes in their data lake is significantly on the rise. Customer service and sales needs—as well as the ever-increasing challenges of IT planning—are driving this demand. To better manage it all, companies are turning to the cloud for big data processing, while seeking to invest in self-servicing analytics solutions. More than 400 data professionals took part in the survey, which was conducted by Dimensional Research. The following slide show presents selected findings from the survey, with charts provided courtesy of Qubole.

      2Data Lake Size Increasing Rapidly

      Data Lake Size Increasing Rapidly

      The average enterprise data lake size is sharply rising, with 44 percent of organizations now reporting that they have more than 100 terabytes. In 2017, just 36 percent of organizations had more than 100 terabytes.

      3Companies Turn to Cloud for Processing Needs

      Companies Turn to Cloud for Processing Needs

      Nearly three-quarters of organizations use the cloud for big data processing. In 2017, only 58 percent did so.

      4App Data Integration Leads Required Tasks

      App Data Integration Leads Required Tasks

      When asked what types of big data processing they perform, 75 percent of survey respondents listed app data integration. Ad hoc analytics came second, as cited by 53 percent of respondents, followed by streaming data (40 percent) and machine learning (also 40 percent).

      5Efforts Geared to Support Customers

      Efforts Geared to Support Customers

      In terms of big data business function drivers, customer service ranks No. 1, as cited by 40 percent of respondents. IT planning finished a close second, as cited by 38 percent, followed by sales (33 percent), finance (also 33 percent) and resource planning (32 percent).

      6ERP Emerges as Prime Data Source

      ERP Emerges as Prime Data Source

      Enterprise resource planning tools serve as the top source of big data, as cited by 57 percent of respondents. Both customer relationship management/customer experience and finance solutions ranked second, as cited by 38 percent of respondents.

      7Spark Ranks as Most Popular Framework

      Spark Ranks as Most Popular Framework

      More than three of 10 respondents said their organization uses Spark as a big data framework. One-quarter listed homegrown frameworks, and 17 percent cited Hive and HBase.

      8Enterprises Eye Self-Serviced Analytics

      Enterprises Eye Self-Serviced Analytics

      Less than one of 10 organizations support self-serviced big data analytics. But just over three of five are planning to do so.

      9Increased Staffing Expected to Address Talent Gap

      Increased Staffing Expected to Address Talent Gap

      Three-quarters of respondents said their company is dealing with a big data talent and resource gap. To address this, 79 percent said their organization plans to boost headcount.

      10Administrative Inefficiencies Revealed

      Administrative Inefficiencies Revealed

      Just 40 percent of organizations support more than 25 users per big data administrator. By using more advanced, available platforms, administrators should be able to serve more than 100 users, according to the report.

      11Lack of Experience Hinders Progress

      Lack of Experience Hinders Progress

      When asked about their biggest big data challenge, 44 percent of respondents cited a “lack of experience” that “slows progress.” Other top challenges included the inability to keep up with new data sources (as cited by 42 percent of respondents), constantly evolving use cases (41 percent) and an abundance of manual tasks (38 percent).

      PrevNext

      MOST POPULAR ARTICLES

      Cybersecurity

      Visa’s Michael Jabbara on Cybersecurity and Digital...

      James Maguire - May 17, 2022 0
      I spoke with Michael Jabbara, VP and Global Head of Fraud Services at Visa, about the cybersecurity technology used to ensure the safe transfer...
      Read more
      Cloud

      Yotascale CEO Asim Razzaq on Controlling Multicloud...

      James Maguire - May 5, 2022 0
      Asim Razzaq, CEO of Yotascale, provides guidance on understanding—and containing—the complex cost structure of multicloud computing. Among the topics we covered:  As you survey the...
      Read more
      Big Data and Analytics

      GoodData CEO Roman Stanek on Business Intelligence...

      James Maguire - May 4, 2022 0
      I spoke with Roman Stanek, CEO of GoodData, about business intelligence, data as a service, and the frustration that many executives have with data...
      Read more
      Applications

      Cisco’s Thimaya Subaiya on Customer Experience in...

      James Maguire - May 10, 2022 0
      I spoke with Thimaya Subaiya, SVP and GM of Global Customer Experience at Cisco, about the factors that create good customer experience – and...
      Read more
      IT Management

      Intuit’s Nhung Ho on AI for the...

      James Maguire - May 13, 2022 0
      I spoke with Nhung Ho, Vice President of AI at Intuit, about adoption of AI in the small and medium-sized business market, and how...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2021 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×