# NewSQL Databases Assessment: CockroachDB, MariaDB Xpand, and VoltDB
###### Abstract  
Background: Relational databases have been a prevalent technology for decades, using SQL (Structured Query Language) to manage data. However, the emergence of new technologies, such as the web and the cloud, has brought the requirement to handle more complex data. NewSQL is the latest technology that incorporates the ability to scale and ensures the availability of NoSQL. (Not Only SQL) without losing the ACID properties (Atomicity, Consistency, Isolation, Durability) associated with relational databases. Methods: We evaluated CockroachDB, MariaDB Xpand, and VoltDB with OSpal methodology and experimentally using the Star Schema Benchmark (SSB). The scalability and performance capabilities of each database were assessed. Results: Applying the OSSpal methodology, the results showed that MariaDB Xpand outperformed CockroachDB and VoltDB. On the other hand, we concluded that with Star Schema Benchmark, CockroachDB had better scalability, while VoltDB had a faster query execution time. Conclusions: CockroachDB and VoltDB are the best performing databases in terms of scalability and performance. Keywords:SQL; NewSQL; OSpal; SSB; CockroachDB; MariaDB Xpand; VoltDB +
Footnote †: journal:  
streaming data, either from cameras or sensors, organizing a team and assigning roles and responsibilities, risk monitoring forecast, financial markets, Internet of Things, etc. There is no doubt that without NewSQL, these systems could only be developed using multiple systems at too high a price, and some of these applications would not perform as fast [8]. Moreover, NewSQL databases are designed to meet distributed architectures and scalability requirements, improving performance in such a way that horizontal scalability is a reality and incorporating new storage mechanisms [9]. This paper assesses three of the most popular NewSQL databases according to DB-Engines Ranking 2022 [10]: CockroachDB [11], MariaDB Xpand [12], and VoltDB [13]. The main purpose of this work is to decide which one has the best functionalities based on the OSSpal methodology and experimentally using the Star Schema Benchmark (SSB) to test its scalability and performance. The open source software assessment methodology, OSSpal, came out as a successor of the Business Readiness Rating (OpenBRR), allowing users to make an evaluation with decisive questions divided into categories [14]. OSSpal methodology combines quantitative and qualitative software evaluation measures, which results in a numerical value that permits the comparison between applications. Some categories, which accommodate common characteristics, will be used to evaluate the open source and commercial solutions. OSSpal methodology has been used by the scientific community in several scientific papers and dissertations [15; 16; 17; 18; 19]. However, to the best of our knowledge, this is one of the first studies to apply the OSSpal methodology to NewSQL databases. Star Schema Benchmark (SSB) is a benchmark designed as an alternative to TPC-H Benchmark. It is based on the TPC-H benchmark model with improvements that implement a traditional star schema. Its goal is to measure the performance of database products and to test a star schema strategy [20]. In the experiments using OSSpal methodology, we conclude that MariaDB has a higher score than CockroachDB and VoltDB. Each NewSQL database was evaluated using a collection of functionalities retrieved from the DB-Engines Ranking 2022, and other common characteristics that allowed us to determine which database is the best. In the experimental evaluation, using the Star Schema Benchmark, CockroachDB presented improved results in scalability, while VoltDB had better results in query execution time.