Close
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Cybersecurity
    • Cybersecurity

    Open Network Insight Project Builds on Big Data to Improve Security

    By
    Sean Michael Kerner
    -
    April 4, 2016
    Share
    Facebook
    Twitter
    Linkedin
      Open Network Insight

      Using big data to collect network events in an effort to help improve security is not a new concept, but it is evolving. Part of the evolution is coming by way of the open-source Open Network Insight (ONI) project, which has been generally available for just over a month and is already being used by Intel.

      Helping to lead the ONI effort is Cloudera, one of the leading vendors and participants in the development of the Hadoop big data platform. ONI isn’t just Hadoop though, as simply having big data is not the same as understanding the data and making sense of it to improve security outcomes. In addition to Hadoop, ONI includes the open-source Wireshark project, which is a widely used packet sniffing and analysis technology; nfdump, which is a netflow network packet capture tool; and the D3 JavaScript visualization library and the Jupyter project for reporting.

      “Hadoop is a really great platform for storing cyber-security information, and this is a use case that we see across industries,” Eddie Garcia, chief security architect at Cloudera, told eWEEK.

      By making use of Hadoop as the back end for storing data, Garcia noted that that an organization can look at and analyze more data than by using a non-big data approach. From a community perspective over the last month, ONI has seen adoption and contributions by eBay and Accenture, among other organizations. Garcia noted that eBay is using ONI for its own security needs, while Accenture is now running ONI as a managed service for clients.

      One of the challenges of using Hadoop as the basis of a security platform is that many organizations have built their own approaches and there hasn’t been a standard model, but that’s something ONI is aiming to address, according to Garcia. When dealing with network security, among the challenges that ONI helps to solve is how to represent network data in Hadoop in a common model and format, regardless of the network device or vendor that the data comes from.

      “What we’re enabling is a platform to store network data and do analytics on top,” he said. “In the future, what we see is an open model to enable other threat and security analysis, including users and servers.”

      While the current iteration of ONI has a focus on network events, the platform is also useful for performing User Behavior Analytics (UBA), which is an increasingly common security activity for detecting anomalous user activity.

      “A user is going to have an IP address,” Garcia said. “From that perspective, you can already do some user analytics with ONI today.”

      What ONI is missing, he noted, is the direct correlation to the user and all the different devices that a particular user might be using to access a network. Work to enable more robust UBA is ongoing in ONI.

      From a reporting perspective, Garcia explained that the Jupyter component helps to power the ONI dashboard. Currently in the ONI dashboard, it’s possible for an administrator to drill down into specific events and IP addresses, as well as filter by date and packet header information. As ONI community partners and users continue to embrace the platform, Garcia expects that vendors will build their own tools on top of ONI for even more functionality.

      Despite only having been publicly available for a month, Garcia said the ONI project is already in production at Intel, which is also one of the core contributors and founders of the project.

      “This technology grew out of a necessity that the number of events Intel was receiving outpaced the technology that they had,” he said. “Now with Hadoop behind it, Intel is able to capture and analyze data across 20 billion events they receive daily.”

      Sean Michael Kerner is a senior editor at eWEEK and InternetNews.com. Follow him on Twitter @TechJournalist.

      Sean Michael Kerner
      Sean Michael Kerner is an Internet consultant, strategist, and contributor to several leading IT business web sites.

      MOST POPULAR ARTICLES

      Cybersecurity

      Visa’s Michael Jabbara on Cybersecurity and Digital...

      James Maguire - May 17, 2022 0
      I spoke with Michael Jabbara, VP and Global Head of Fraud Services at Visa, about the cybersecurity technology used to ensure the safe transfer...
      Read more
      Cloud

      Yotascale CEO Asim Razzaq on Controlling Multicloud...

      James Maguire - May 5, 2022 0
      Asim Razzaq, CEO of Yotascale, provides guidance on understanding—and containing—the complex cost structure of multicloud computing. Among the topics we covered:  As you survey the...
      Read more
      Big Data and Analytics

      GoodData CEO Roman Stanek on Business Intelligence...

      James Maguire - May 4, 2022 0
      I spoke with Roman Stanek, CEO of GoodData, about business intelligence, data as a service, and the frustration that many executives have with data...
      Read more
      Android

      Samsung Galaxy XCover Pro: Durability for Tough...

      Chris Preimesberger - December 5, 2020 0
      Have you ever dropped your phone, winced and felt the pain as it hit the sidewalk? Either the screen splintered like a windshield being...
      Read more
      IT Management

      Intuit’s Nhung Ho on AI for the...

      James Maguire - May 13, 2022 0
      I spoke with Nhung Ho, Vice President of AI at Intuit, about adoption of AI in the small and medium-sized business market, and how...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2021 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×