Project Caerus: Compute Storage Coordination
Channel: OpenInfra Foundation
Date: 05/11/2020

Big data and AI applications are proliferating rapidly, which are compute-, IO-, and memory-intensive, imposing significant performance and scalability challenges on the underlying compute and storage systems. Typically, distributed data-parallel data processing engines (e.g., Spark and TensorFlow) and distributed storage systems (e.g., S3 and Ceph) are developed and managed independently. The disaggregation of compute and storage has made it difficult to perform end-to-end optimization or to fully exploit hardware resource capacity available in the overall system. Project Caerus aims to create a new open ecosystem that allows compute and storage platforms from different sources to operate in a concerted fashion to substantially improve application performance, resource utilization, and application developer productivity.

Moderators: Hui Lei, Orran Krieger
Track: Forum