eWEEK content and product recommendations are editorially independent. We may make money when you click on links to our partners. Learn More.
Big data processing optimization provider Pepperdata said March 7 that it is expanding its product portfolio with a DevOps tool that offers Hadoop and Spark developers with easy-to-understand recommendations for improving job performance.
Application Profiler, based on the colorfully named open source project Dr. Elephant, is currently available in early access and will be generally available in the second quarter of 2017, the Cupertino, Calif.-based company said.
New-gen distributed systems and applications are getting more complex all the time, and achieving optimal performance remains one of the most significant challenges of a big data system. Pepperdata’s newest product is designed to untangle those complexities.
Application Profiler is based on the open source Dr. Elephant project originally created by LinkedIn. Application Profiler and Dr. Elephant aim to improve Hadoop and Spark developer productivity and increase cluster efficiency by making clear recommendations on how to tune workloads and configurations.
Brings Capabilities of Dr. Elephant to the Fore
The app profiler delivers the capabilities of Dr. Elephant as a simple-to-adopt SaaS offering that Pepperdate claims is easy to deploy and use. Application Profiler supports Spark and MapReduce on all standard Hadoop distributions: Cloudera, Hortonworks, MapR, IBM and Apache.
“Our close work with LinkedIn and Dr. Elephant represents a new open source focus for Pepperdata,” CEO Ash Munshi said. “Tighter integration of our products with open source projects provides greater value to our customers and will drive significantly faster innovation and adoption. Not only are we responding swiftly to our customers’ needs, but we are also embracing the larger community through open source.”
Application Profiler is the first of several new products that Pepperdata will be releasing this year that are targeted at DevOps for Big Data, the company said. These products improve support for developers and operators, using the experience Pepperdata has gained working with DevOps teams running production clusters.
Brings DevOps Sensibilities to Workloads
Pepperdata products and services are designed to accelerate the production use of big data applications by ensuring that performance is tightly integrated into the DevOps for big data cycle.
Along with the introduction of Application Profiler, Pepperdata has organized its current offerings into an integrated suite of products:
Pepperdata Cluster Analyzer:
–correlates cluster-wide events to users and jobs
–identifies rogue users and applications
–gets accurate chargeback reporting
–reports on capacity trends
Pepperdata Capacity Optimizer:
–runs more jobs on existing clusters
–runs jobs faster on existing clusters
–automatically reclaims wasted resources
–fully utilizes infrastructure investment
Pepperdata Policy Enforcer:
–ensures on-time execution of critical jobs to meet Quality of Service commitments
–supports multi-tenancy allowing business critical workloads and less-critical workloads to share the same cluster
–safely runs ad-hoc jobs without impacting critical workloads
Application Profiler is available in early access and will be generally available in Q2 2017, the company said.
Pepperdata products are delivered to market as a combination of software running on customers’ clusters, on-premises, in the cloud and as SaaS solutions. For pricing information or to schedule a demo, contact this email address.
For more information, go here.