Close
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Applications
    • Applications
    • Big Data and Analytics
    • Cloud
    • Database
    • Development

    Azure HDInsight Analytics Platform Now Supports Apache Hadoop 3.0

    By
    Todd R. Weiss
    -
    April 18, 2019
    Share
    Facebook
    Twitter
    Linkedin
      Apache Hadoop

      Microsoft has announced that Apache Hadoop 3.0 is now generally available on the Azure HDInsight analytics platform, along with a variety of improvements and enhancements aimed at providing more analytics data to users.

      The Apache Hadoop 3.0 news was announced by Arindam Chatterjee, the principal group program manager for Azure HDInsight, in an April 15 post on the Microsoft Azure Blog.

      “With the general availability of Apache Hadoop 3.0 on Azure HDInsight, we are building upon existing capabilities with a number of key enhancements that further improve performance and security and deepen support for the rich ecosystem of big data analytics applications,” wrote Chatterjee.

      Azure HDInsight, a managed open-source analytics service for enterprises, works in conjunction with a variety of open-source frameworks, including Hadoop, Apache Spark, Apache Hive, LLAP, Apache Kafka, Apache Storm and R. Azure HDInsight allows users to quickly process large stores of data for analysis.

      Azure HDInsight services are available in 30 public regions and Azure Government Clouds in the United States and Germany, allowing users to perform a variety of analyses on mission-critical data in a wide range of business segments.

      Several important new features in Apache Hadoop 3.0 will help users get the most out their Azure HDInsight analyses, wrote Chatterjee, including the inclusion of Apache Hive 3.0 which will allow developers to build traditional database applications on massive data lakes. “This is particularly important for enterprises who need to build GDPR/privacy compliant big data applications,” he wrote.

      Also new to Apache Hadoop 3.0 is a Hive Warehouse Connector for Apache Spark, which allows developers to move data integrations from the metastore layer to the query engine layer, enabling higher and more reliable performance, wrote Chatterjee.

      In addition, Apache HBase 2.0 and Apache Phoenix 5.0 have received a number of performance, stability and integration improvements, such as Phoenix 5.0 bringing more visibility into queries with query log by introducing a new system table that captures information about queries that are being run against the cluster.

      Upgraded Security, Compliance Features

      Enterprise-grade security and compliance features are also upgraded in the new version, which is a critical requirement for customers building big data applications that store or process sensitive data in the cloud, wrote Chatterjee.

      Among the security improvements are Enterprise Security Package (ESP) support for Apache HBase, which allows users to authenticate to their HDInsight HBase clusters using their corporate domain credentials, while being subject to rich, fine-grained access policies, he continued. Also included in the latest Apache Hadoop is Bring Your Own Key (BYOK) support for Apache Kafka, which allows customers to now bring their own encryption keys into the Azure Key Vault and use them to encrypt the Azure Managed Disks storing their Apache Kafka messages.

      “We look forward to seeing what innovations you will bring to your users and customers with Azure HDInsight,” wrote Chatterjee. “Read the developer guide and follow the quick start guide to learn more about implementing open source analytics pipelines on Azure HDInsight.”

      Azure HDInsight supports an expanding application ecosystem with a variety of popular big data applications available on Azure Marketplace for tasks such as interactive analytics to application migration.

      Todd R. Weiss
      As a technology journalist covering enterprise IT for more than 15 years, I joined eWEEK.com in September 2014 as the site's senior writer covering all things mobile. I write about smartphones, tablets, laptops, assorted mobile gadgets and services,mobile carriers and much more. I formerly was a staff writer for Computerworld.com from 2000 to 2008 and previously wrote for daily newspapers in eastern Pennsylvania. I'm an avid traveler, motorcyclist, technology lover, cook, reader, tinkerer and mechanic. I drove a yellow taxicab in college and collect toy taxis and taxi business cards from around the world.

      MOST POPULAR ARTICLES

      Big Data and Analytics

      Alteryx’s Suresh Vittal on the Democratization of...

      James Maguire - May 31, 2022 0
      I spoke with Suresh Vittal, Chief Product Officer at Alteryx, about the industry mega-shift toward making data analytics tools accessible to a company’s complete...
      Read more
      Cybersecurity

      Visa’s Michael Jabbara on Cybersecurity and Digital...

      James Maguire - May 17, 2022 0
      I spoke with Michael Jabbara, VP and Global Head of Fraud Services at Visa, about the cybersecurity technology used to ensure the safe transfer...
      Read more
      Applications

      Cisco’s Thimaya Subaiya on Customer Experience in...

      James Maguire - May 10, 2022 0
      I spoke with Thimaya Subaiya, SVP and GM of Global Customer Experience at Cisco, about the factors that create good customer experience – and...
      Read more
      Cloud

      IGEL CEO Jed Ayres on Edge and...

      James Maguire - June 14, 2022 0
      I spoke with Jed Ayres, CEO of IGEL, about the endpoint sector, and an open source OS for the cloud; we also spoke about...
      Read more
      Cloud

      Yotascale CEO Asim Razzaq on Controlling Multicloud...

      James Maguire - May 5, 2022 0
      Asim Razzaq, CEO of Yotascale, provides guidance on understanding—and containing—the complex cost structure of multicloud computing. Among the topics we covered:  As you survey the...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2022 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×