Close
  • Latest News
  • Artificial Intelligence
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Artificial Intelligence
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Database
    • Database

    Splunk Brings Google-Like Search to the Data Center

    By
    Lisa Vaas
    -
    August 9, 2005
    Share
    Facebook
    Twitter
    Linkedin

      A band of search gurus on Monday announced what they claim is the first search engine designed for rifling through machine code in order to troubleshoot the data center.

      The San Francisco startup, named Splunk, brings together talent culled from Infoseek, SourceForget.net and Yahoo Inc.

      CEO Michael Baum—former vice president of e-commerce at InfoSeek—said that the creation of the Splunk Personal Server was inspired by the hassles of building and managing data center environments.

      “We discovered the problem has moved from managing the physical hardware to managing the logical infrastructure: how all these different components of software, whether in the firewall, router or database server, are all talking to each other,” he said.

      The startup team has spent the past three years studying the problem and bringing their collective experience at building large-scale search engines for the Internet to the problem of applying search technology to this very different domain.

      “At Infoseek and Yahoo, the problem was all about HTML documents, all about, How can I bring sub-second query response times to tens of millions of users at the same time?” Baum said.

      Given that Internet searches take place in one language at a time, that challenge was a piece of cake compared with the difficulty of indexing and searching machine-generated data in the form of log files or traffic coming over a messaging bus, for example, Baum said.

      In a typical data center, troubleshooting means poring over machine data from a wide array of machine languages, usually with nothing in common except the time and date.

      “IDC and Gartner talk about $100 billion being spent in 2005 in managing the worlds data centers,” Baum said. “Most is spent on manual troubleshooting.”

      Baum compared the current state of troubleshooting to using the Internet without a search engine. “Fifteen years ago, when the Internet was used by just technical people, they used to look through directories of files on machines to find the document they were interested in,” he said. “And theyd do it by hand. Once they found the document they were interested in, you find it, find a couple of interesting concepts, but there were no documents linked. You have to go find related documents. Thats literally what people have to do in the data center. Its a very painful process that takes a lot of time and takes a lot of experts from different domains.”

      An example of the type of scenario in a data center thats a pain to troubleshoot is when a VoIP (Voice Over IP) stack runs phone systems in a call center. That stack will connect to some type of CRM (customer relationship management) application, say Siebel or SAP or PeopleSoft. When the stack hits a call, it records call routing data, hits the CRM, which looks up the number, and then executes a call-routing function.

      The single transaction of a customer calling in to get someone on the phone to work on a problem involves leaving a trail of evidence in the data center: within the VoIP stack, the call center and the CRM applications. To understand the complete transaction and why it wasnt completed or why performance was poor, data must be pieced together from all events.

      Thats a manual process today. Splunk is designed to allow users to start with, say, the customers phone number. After typing it in, the search technology will find the first event in the VoIP infrastructure. Like a Google search, Splunk returns a list of links to similar or related events. Through advanced data mining techniques, users can click and search to navigate their way through the complex maze of the data center.

      /zimages/1/28571.gifIBM open-sources new search technology. Click here to read more.

      Splunk handles machine-generated data from a list of sources that includes Web servers, application servers, e-mail servers, databases and network devices. Users access the Splunk Servers AJAX interface through a Web browser. Once data is indexed, users can navigate through systems using time and keyword searches or can navigate the links of event relationships by pointing and clicking on Splunks results.

      Twenty-five companies in a range of industries have been beta testing Splunk since June. Splunk is now available for free public beta download.

      The founders are also planning to launch sometime this week SplunkForge.net, a community site for open-source development of services around the Splunk server kernel. The site will already have been seeded with modules to extend the server with services such as making the search faster or managing and dealing with large, distributed infrastructures.

      /zimages/1/28571.gifCheck out eWEEK.coms for the latest database news, reviews and analysis.

      Lisa Vaas
      Lisa Vaas is News Editor/Operations for eWEEK.com and also serves as editor of the Database topic center. Since 1995, she has also been a Webcast news show anchorperson and a reporter covering the IT industry. She has focused on customer relationship management technology, IT salaries and careers, effects of the H1-B visa on the technology workforce, wireless technology, security, and, most recently, databases and the technologies that touch upon them. Her articles have appeared in eWEEK's print edition, on eWEEK.com, and in the startup IT magazine PC Connection. Prior to becoming a journalist, Vaas experienced an array of eye-opening careers, including driving a cab in Boston, photographing cranky babies in shopping malls, selling cameras, typography and computer training. She stopped a hair short of finishing an M.A. in English at the University of Massachusetts in Boston. She earned a B.S. in Communications from Emerson College. She runs two open-mic reading series in Boston and currently keeps bees in her home in Mashpee, Mass.
      Get the Free Newsletter!
      Subscribe to Daily Tech Insider for top news, trends & analysis
      This email address is invalid.
      Get the Free Newsletter!
      Subscribe to Daily Tech Insider for top news, trends & analysis
      This email address is invalid.

      MOST POPULAR ARTICLES

      Latest News

      Zeus Kerravala on Networking: Multicloud, 5G, and...

      James Maguire - December 16, 2022 0
      I spoke with Zeus Kerravala, industry analyst at ZK Research, about the rapid changes in enterprise networking, as tech advances and digital transformation prompt...
      Read more
      Applications

      Datadog President Amit Agarwal on Trends in...

      James Maguire - November 11, 2022 0
      I spoke with Amit Agarwal, President of Datadog, about infrastructure observability, from current trends to key challenges to the future of this rapidly growing...
      Read more
      IT Management

      Intuit’s Nhung Ho on AI for the...

      James Maguire - May 13, 2022 0
      I spoke with Nhung Ho, Vice President of AI at Intuit, about adoption of AI in the small and medium-sized business market, and how...
      Read more
      Applications

      Kyndryl’s Nicolas Sekkaki on Handling AI and...

      James Maguire - November 9, 2022 0
      I spoke with Nicolas Sekkaki, Group Practice Leader for Applications, Data and AI at Kyndryl, about how companies can boost both their AI and...
      Read more
      Cloud

      IGEL CEO Jed Ayres on Edge and...

      James Maguire - June 14, 2022 0
      I spoke with Jed Ayres, CEO of IGEL, about the endpoint sector, and an open source OS for the cloud; we also spoke about...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2022 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×