NEW YORK—MongoDB beat out NoSQL databases in a recent benchmark study that measured performance and scalability in real-world deployments, as it aims to become the new default database option for enterprises.
At the MongoDB World 2015 conference here, MongoDB announced that United Software Associates, an independent benchmarking and performance testing organization, delivered results of its benchmark report that showed MongoDB provided greater scalability than Cassandra and Couchbase in all tests, by as much as 13 times.
Indeed, the research, based on the Yahoo! Cloud Serving Benchmark (YCSB), showed that MongoDB outperforms Cassandra and Couchbase in deployments where the data size exceeds that of RAM, where data is partitioned across multiple servers, and where data is replicated for high availability. The full performance benchmark study is available here for download.
"While performance is important, it must be considered along with many different criteria when evaluating database technology," said Sam Bhat, CEO of United Software Associates, in a statement. "The goal of this report is to take a closer look at scalability, another critical factor used to determine the right database technology for a project. MongoDB proved to have the best and most predictable scalability, better than either of the niche NoSQL products. With these tests we can confidently say MongoDB is well suited for the widest range of applications, and is also at the forefront of databases in terms of performance and scalability."
MongoDB said the study results are based on evaluation of two workloads using YCSB: Workload A, an equal mix of reads and updates, and Workload B, which consists of 95 percent reads and 5 percent updates. All tests were performed with 400M records distributed across three servers, which represents a data set larger than RAM. Each test performs 100M operations and records throughput and latencies at the 95th and 99th percentiles for reads and updates separately.
According to the results of the study, in the 50/50 workload, MongoDB provides over 1.8 times greater throughput than Cassandra, and nearly 13 times greater throughput than Couchbase. And in the read-dominant workload, MongoDB provides over 1.75 times the throughput of Cassandra, and over 6 times the throughput of Couchbase.
"In this research, our goal was to evaluate the performance of MongoDB and NoSQL databases, for reads and writes, across a range of durability scenarios, putting each product on a level-playing field," Bhat noted. "Our results show that in every scenario, MongoDB with WiredTiger clearly outperforms its competition. We were surprised to find that, even with its more extensive feature set, MongoDB outperformed key value stores at what they do best. However, as YCSB only tests a small set of the requirements necessary for any application, organizations should carefully test all their requirements to make smart choices about their database technology. We have posted the tests on GitHub so others can reproduce our findings.”
The study helps to bolster MongoDB President and CEO Dev Ittycheria's claim that the time is now for MongoDB to become "the new default" in the database world. In the opening keynote for the MongoDB World conference, Ittycheria said MongoDB has built a great team and great product, but now is the time to build a great business.
"This is the time; this is the seminal moment where MongoDB becomes the new default," he said.