PLEASANTON, Calif.--(BUSINESS WIRE)--United Software Associates, Inc., an independent benchmarking and performance testing organization, today announced the results of its comprehensive independent database comparison, measuring performance and scalability in real-world deployments. The research, based on the Yahoo! Cloud Serving Benchmark (YCSB), determined MongoDB provides greater scalability than Cassandra and Couchbase in all tests, by as much as 13x.
This report shows that MongoDB overwhelmingly outperforms Cassandra and Couchbase in deployments where the data size exceeds that of RAM, where data is partitioned across multiple servers, and where data is replicated for high availability.
The full performance benchmark study is available for download.
“While performance is important, it must be considered along with many different criteria when evaluating database technology,” said Sam Bhat, CEO of United Software Associates. “The goal of this report is to take a closer look at scalability, another critical factor used to determine the right database technology for a project. MongoDB proved to have the best and most predictable scalability, better than either of the niche NoSQL products. With these tests we can confidently say MongoDB is well suited for the widest range of applications, and is also at the forefront of databases in terms of performance and scalability.”
Benchmark Results
The following results are based on evaluation of two workloads using YCSB: Workload A, an equal mix of reads and updates, and Workload B, which consists of 95% reads and 5% updates. All tests were performed with 400M records distributed across three servers, which represents a data set larger than RAM. Each test performs 100M operations and records throughput and latencies at the 95th and 99th percentiles for reads and updates separately.
About United Software Associates
With 16 years of technology adoption and value engineering experience, United Software Associates helps customers understand the true business value of using emerging technologies. The organization works with some of the world’s leading technology companies and provides valuable guidance to users and developers across industry segments.
“We encourage readers to use our findings as one of many inputs to their own evaluations and to thoroughly test a range of database functionality that fits their application,” said Bhat.
About the Benchmark
United Software Associates used the Yahoo! Cloud Serving Benchmark (YCSB) as the basis for its tests, and evaluated three different configurations: one optimized for durability, one optimized for throughput, and a balanced configuration that provides strong performance and strong durability. The latest versions of each product were used: Couchbase 3.0.2, Cassandra 2.12 and MongoDB 3.0.1 with WiredTiger. In all tests, the best practices for each product were followed and multiple rounds of tests were run to determine the optimal number of threads and best performance for each product.
Detailed testing environment specifications and configurations can be found in the full report.