eWEEK content and product recommendations are editorially independent. We may make money when you click on links to our partners. Learn More.
Syncsort, a provider of high-performance data integration solutions, has announced a new relationship with high-performance computing database and analytics software maker Greenplum to make big data analytics available faster to provide real business value to organizations.
Syncsort has announced that it has certified its DMExpress data integration software for high-performance loading of Greenplum database. The company also announced that it has joined the Greenplum Catalyst Developer Program.
Syncsort DMExpress solutions are used by enterprises to help tame their big data integration challenges, accelerating time-to-insight and reducing the total cost of ownership of big data warehousing and analytics environments, the company said in a press release.
Greenplum, a division of EMC, is enabling data science teams to fully harness the value of big data through its massively parallel processing (MPP) Greenplum database, which is capable of storing and analyzing petabytes of data.
The Greenplum database is at the core of big data analytics, said Josh Klahr, vice president of product management at Greenplum, a division of EMC, in a statement. Were excited to work with Syncsort in furthering our vision to enable customers to rapidly extract the greatest value from vast amounts of data and create more agile, data-driven businesses. When matched with the EMC Greenplum Unified Analytics Platform, our products can help customers significantly accelerate their time-to-insight.
Syncsort DMExpress software delivers extensive connectivity that makes it easy to extract and transform data from nearly any source, and rapidly load it into Greenplum database without the need for manual tuning or custom coding. This results in cleaner, more relevant data being available sooner to drive big data analytics, reducing time-to-insight and optimizing decision making.
Syncsort DMExpress software, operating in concert with the Greenplum Data Integration Accelerator (DIA) Module, can decrease the typical load times associated with big data. In recent benchmark testing, load throughput of more than 12TB per hour was achieved using just four extract, transform and load (ETL) servers.
In order to support and grow a data-intensive business like comScore, we rely on innovative technology that offers the highest performance, extreme resource efficiency, and linear scalability, said Mike Brown, chief technology officer at comScore, in a statement. As a satisfied customer of both Syncsort and Greenplum, we are generating tremendous value from the integration of their products and are now able to load our Greenplum database three times faster using DMExpress than with our previous approach. This enables us to deliver fresher data to our analysts, which enhances the value of our offerings. Were also able to process twice as much data using the same hardware resources, driving substantial cost savings as data volumes continue to grow exponentially.
Companies like comScore, which has created a business selling analytics, understand the critical need for data to be organized before processing. By organizing this data up-front, comScore can process, analyze and get data out to customers faster than its competitors. comScore captures 35 billion records a day, and to make this task more manageable, the company is using Syncsorts DMExpress to cleanse, parse and compress data before loading it into the EMC Greenplum database, which has enabled comScore to process data much faster.
As a Greenplum Catalyst Developer Program member, Syncsort will integrate DMExpress software with the Greenplum Unified Analytics Platform (UAP). As part of this program, the companies will leverage the integration of DMExpress and Greenplum HD to simplify and accelerate the loading and extraction of data to and from the Hadoop Distributed File System (HDFS) and reduce the complexity and cost of developing and executing MapReduce tasks.
IT organizations of all sizes are struggling to keep pace with the spiraling infrastructure demands created by the sheer volume, variety and velocity of big data, said Mitch Seigle, vice president of marketing and product management at Syncsort. By collaborating to create best-in-class solutions for integrating, storing and analyzing big data, Syncsort and Greenplum are helping customers overcome these challenges and enable their businesses to more quickly and cost-effectively benefit from the insights gained.