Close
  • Latest News
  • Cybersecurity
  • Big Data and Analytics
  • Cloud
  • Mobile
  • Networking
  • Storage
  • Applications
  • IT Management
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Menu
Search
  • Latest News
  • Cybersecurity
  • Big Data and Analytics
  • Cloud
  • Mobile
  • Networking
  • Storage
  • Applications
  • IT Management
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Development
    • Development
    • IT Management

    DataPower Breaks 1TB Barrier for XML Processing

    By
    Darryl K. Taft
    -
    March 29, 2005
    Share
    Facebook
    Twitter
    Linkedin

      DataPower Technology Inc. announced that is has broken the terabyte barrier and its technology is able to transform a 1TB XML document.

      Cambridge, Mass.-based DataPower is expected to announce on Monday that its DataPower XA35 XML Accelerator appliance can handle fully streaming XML processing on documents up to 1TB. DataPower officials said streaming processing allows an XML engine to begin producing output before the entire input has been parsed and requires only a constant amount of memory, independent of XML document size.

      Streaming processing was previously only possible using low-level custom programming or special-purpose languages. However, DataPowers approach enables XML developers to use XPath and XSLT (Extensible Stylesheet Language Transformations) standards, while enabling XML documents of unlimited size to be processed, company officials said.

      “In the simplest form, before streaming, processing an XML file required reading the entire file into RAM,” said Eugene Kuznetsov, chairman and chief technology officer at DataPower.

      “Because an XML file in RAM is usually several times larger than on disk, that could mean that a 100MB file, for example, may require 300MB or more of free memory. Obviously, this presents a physical limit on the maximum size of a file that can be processed. With streaming, only a portion of a file has to be in-memory at any one time, and output can be produced before the entire file has been consumed. DataPower streaming compiler technology means there is no maximum size limit and XML files over a terabyte long can be processed.”

      However, some XML processing operations cant be streamed because of their very nature, Kuznetsov said. For example, an XSLT transformation that reverses the order of elements in a file has to buffer all of the input and wait for the last element before it can produce any output, he said. Also, it is often difficult for a developer to determine whether a particular set of XML processing operations can be streamed and to know how later changes may affect “streamability,” he said.

      However, Kuznetsov said DataPowers compiler technology automatically determines which operations can be streamed and processes them in a fully streaming fashion. And with the DataPower XG4 technology and chip set, users do not have to learn new languages or determine which processing can be streamed, company officials said.

      /zimages/4/28571.gifClick here to read more about DataPowers patented XML processing technology.

      DataPower XG4 has been shown to transform a 1TB XML document in XSLT streaming mode, and breaking the “1TB barrier” for XML document size is a milestone, Kuznetsov said. DataPower also was first to break the “1G-bps barrier,” he said.

      “Its really the final frontier in XML processing. No one can say that its too slow (gigabit barrier!) or too verbose (terabyte barrier!) for any application,” Kuznetsov said.

      /zimages/4/28571.gifCheck out eWEEK.coms for the latest news, reviews and analysis in programming environments and developer tools.

      Avatar
      Darryl K. Taft
      Darryl K. Taft covers the development tools and developer-related issues beat from his office in Baltimore. He has more than 10 years of experience in the business and is always looking for the next scoop. Taft is a member of the Association for Computing Machinery (ACM) and was named 'one of the most active middleware reporters in the world' by The Middleware Co. He also has his own card in the 'Who's Who in Enterprise Java' deck.

      MOST POPULAR ARTICLES

      Android

      Samsung Galaxy XCover Pro: Durability for Tough...

      Chris Preimesberger - December 5, 2020 0
      Have you ever dropped your phone, winced and felt the pain as it hit the sidewalk? Either the screen splintered like a windshield being...
      Read more
      Cloud

      Why Data Security Will Face Even Harsher...

      Chris Preimesberger - December 1, 2020 0
      Who would know more about details of the hacking process than an actual former career hacker? And who wants to understand all they can...
      Read more
      Cybersecurity

      How Veritas Is Shining a Light Into...

      eWEEK EDITORS - September 25, 2020 0
      Protecting data has always been one of the most important tasks in all of IT, yet as more companies become data companies at the...
      Read more
      Big Data and Analytics

      How NVIDIA A100 Station Brings Data Center...

      Zeus Kerravala - November 18, 2020 0
      There’s little debate that graphics processor unit manufacturer NVIDIA is the de facto standard when it comes to providing silicon to power machine learning...
      Read more
      Apple

      Why iPhone 12 Pro Makes Sense for...

      Wayne Rash - November 26, 2020 0
      If you’ve been watching the Apple commercials for the past three weeks, you already know what the company thinks will happen if you buy...
      Read more
      eWeek


      Contact Us | About | Sitemap

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Property of TechnologyAdvice.
      Terms of Service | Privacy Notice | Advertise | California - Do Not Sell My Information

      © 2021 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×