Close
  • Latest News
  • Cybersecurity
  • Big Data and Analytics
  • Cloud
  • Mobile
  • Networking
  • Storage
  • Applications
  • IT Management
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Menu
Search
  • Latest News
  • Cybersecurity
  • Big Data and Analytics
  • Cloud
  • Mobile
  • Networking
  • Storage
  • Applications
  • IT Management
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Database
    • Database

    Informatica Plugs Hadoop Into the Internet of Things

    By
    Darryl K. Taft
    -
    October 29, 2013
    Share
    Facebook
    Twitter
    Linkedin

      NEW YORK—Informatica, a provider of data integration software, has announced a new streaming data collection technology to plug Hadoop into the Internet of things.

      The new technology, known as Informatica Vibe Data Stream for Machine Data, is designed to simplify big data collection of machine data from many sources and its delivery to Hadoop, and a wide range of other targets, over any geographic boundary, the company said.

      Informatica made the announcement at the O’Reilly Strata Conference and Hadoop World event here.

      Informatica Vibe Data Stream for Machine Data makes high-volume, high-velocity and high-scale streaming data collection available. It is built on Informatica’s fast, high-performing messaging technology. Customers deploying Informatica’s Vibe Data Stream for Machine Data software will be able to deliver holistic operational intelligence across the enterprise by collecting previously difficult to access data, the company said.

      “Vibe Data Stream provides efficient, high-performance streaming data collection from sensors, mobile devices, log files, and generally machine data from the Internet of things,” said Ash Kulkarni, senior vice president and general manager of data integration at Informatica, in a statement. “This technology easily delivers previously difficult to collect data directly to targets in real time, enabling companies to find deeper insights in this type of machine-generated big data.”

      Informatica Vibe Data Stream for Machine Data is a key new component of Informatica’s end-to-end data integration platform, powered by Informatica Vibe, the company’s embeddable virtual data machine (VDM). Informatica Vibe Data Stream uses embeddable Vibe agents to collect data in real time and stream millions of records per second into big data platforms such as Hadoop and Cassandra. Informatica Vibe Data Stream also streams data directly into Informatica PowerCenter and Informatica CEP, enabling real-time event processing and analytics.

      “At Cloudera, we’re seeing customers across industries come to depend on Hadoop-based platforms to create enterprise data hubs for big data projects,” Charles Zedlewski, vice president of products at Cloudera, said in a statement. “This new offering from Informatica will help organizations capture the value of all their data with an easy-to-use, powerful solution for stream data processing on Hadoop.”

      Many companies and industries need to efficiently perform high-volume, high-velocity and high-scale streaming data collection over LAN and WAN environments—to enable real-time big data analytics and operational intelligence.

      However, current architectures to achieve this require large amounts of infrastructure resources, including servers and storage, and high levels of software development expertise. Consequently, this ability currently is beyond the reach of many companies, Informatica officials said. Also, competing solutions require additional coding or development to approximate the capabilities of Informatica’s Vibe Data Stream for Machine Data technology, and those solutions typically lack the performance, reliability, efficiency and ease-of-use of Vibe Data Stream for Machine Data.

      Informatica Plugs Hadoop Into the Internet of Things

      Informatica’s Vibe Data Stream for Machine Data technology meets this challenge by making reliable, high-throughput streaming data collection broadly available to many companies. A centralized interface enables simplified set-up, deployment, administration and monitoring. Moreover, flexible configurations can be created for a variety of sources to target patterns.

      “Informatica’s Vibe Data Stream for Machine Data is an important addition to the modern data architecture,” Shaun Connolly, vice president of corporate strategy at Hortonworks, said in a statement. “Vibe Data Stream for Machine Data ensures timely data delivery between Hadoop and the rest of the enterprise by providing reliable, high-volume stream data collection and support for large data distributions with high throughput and concurrency.”

      Customers can take advantage of Informatica Vibe Data Stream for Machine Data technology by deploying data collectors or Vibe agents on various sources, which then provide streaming data collection and distribution through a high-performance messaging bus based on Informatica Ultra Messaging. Informatica Vibe Data Stream for Machine Data delivers the data directly to multiple targets for either stream processing for real-time analytics or batch processing for big data analytics and transactional applications.

      “As companies implement more big data solutions, the need to use high-performance message delivery with those solutions will grow,” wrote Gartner in a July report, Hype Cycle for Big Data, 2013. “Moreover, the demands of real-time systems, particularly the Internet of things, mobile devices and world-class cloud applications, will drive adoption of high-performance message delivery, even when big data database technology is not involved.”

      Customers in the logistics, transportation and manufacturing industries, for example, could use Informatica Vibe Data Stream for Machine Data technology for device, sensor or machine data collection. Web entities or retail operations could take advantage of Informatica Vibe Data Stream for Machine Data for Web log data, and telecommunications network operators and utilities could use Vibe Data Stream for Machine Data for network or switch data, the company said.

      “By using MapR and Informatica Vibe Data Stream for Machine Data, companies gain the benefit of enterprise-grade capabilities for real-time streaming into Hadoop,” Jack Norris, chief marketing officer at MapR Technologies, said in a statement. “This enables highly available, efficient, and reliable real-time data collection and streaming across a wide variety of data sources over local and wide area networks.”

      Informatica currently is conducting customer trials of its Vibe Data Stream for Machine Data technology and plans to make it generally available later in the fourth quarter of 2013. The company also will provide, later in the fourth quarter, an SDK customers can use to develop agents for custom sources and targets.

      Avatar
      Darryl K. Taft
      Darryl K. Taft covers the development tools and developer-related issues beat from his office in Baltimore. He has more than 10 years of experience in the business and is always looking for the next scoop. Taft is a member of the Association for Computing Machinery (ACM) and was named 'one of the most active middleware reporters in the world' by The Middleware Co. He also has his own card in the 'Who's Who in Enterprise Java' deck.

      MOST POPULAR ARTICLES

      Android

      Samsung Galaxy XCover Pro: Durability for Tough...

      Chris Preimesberger - December 5, 2020 0
      Have you ever dropped your phone, winced and felt the pain as it hit the sidewalk? Either the screen splintered like a windshield being...
      Read more
      Cloud

      Why Data Security Will Face Even Harsher...

      Chris Preimesberger - December 1, 2020 0
      Who would know more about details of the hacking process than an actual former career hacker? And who wants to understand all they can...
      Read more
      Cybersecurity

      How Veritas Is Shining a Light Into...

      eWEEK EDITORS - September 25, 2020 0
      Protecting data has always been one of the most important tasks in all of IT, yet as more companies become data companies at the...
      Read more
      Big Data and Analytics

      How NVIDIA A100 Station Brings Data Center...

      Zeus Kerravala - November 18, 2020 0
      There’s little debate that graphics processor unit manufacturer NVIDIA is the de facto standard when it comes to providing silicon to power machine learning...
      Read more
      Apple

      Why iPhone 12 Pro Makes Sense for...

      Wayne Rash - November 26, 2020 0
      If you’ve been watching the Apple commercials for the past three weeks, you already know what the company thinks will happen if you buy...
      Read more
      eWeek


      Contact Us | About | Sitemap

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Property of TechnologyAdvice.
      Terms of Service | Privacy Notice | Advertise | California - Do Not Sell My Information

      © 2021 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×