Introducing Prestissimo, Presto's Next-Gen Query Execution Engine - Aditi Pandit, Ahana
Channel: The Linux Foundation
Date: 2023-05-25

Introducing Prestissimo, Presto's Next-Gen Query Execution Engine - Aditi Pandit, Ahana

Presto (https://prestodb.io/) is an Open Source SQL query engine for data analytics and the open data lakehouse. Presto is fast, reliable and efficient at scale. Several internet companies like Meta, Uber and ByteDance have massive Presto deployments. It is used in 300 PB, 10K+ compute cores, 100M+ daily queries, 7K weekly users size systems. A key initiative in Presto is the development of a new C++ (vs old Java) query execution engine called Prestissimo. The new engine shows a huge gain in price-performance, as much as 1/3 of prior CPU use. The C++ infrastructure is more reliable and avoids the performance cliffs due to Java GC. The operational experience is smoother as well due to the visibility into the engine internals. Prestissimo is built on Velox (https://engineering.fb.com/2022/08/31/open-source/velox/). Velox is an open-source library of vectorized data processing primitives for query engines. Velox is reused across Presto, Spark, streaming and machine learning engines at Meta. New projects like Gluten (https://github.com/oap-project/gluten) are also Velox-based. Velox OSS has a strong community with engineers from Meta, Ahana, Intel, Bytedance and others. This talk will give an overview of Prestissimo and Velox and the improvements we have seen.