Data Systems at Scale in Climate and Weather: Activities in the ESiWACE Project
Channel: The Virtual Institute for I/O
Date: 26/06/2020

Presented by Julian Kunkel (University of Reading)

The ESiWACE project aims to enable global eddy-resolving weather and climate simulations on the upcoming (pre-)Exascale supercomputers. In this talk, a selection of efforts to mitigate the effects of the data deluge from such high-resolution simulations is introduced. In particular, we describe the advances in the Earth System Data Middleware (ESDM), which enables scalable data management and supports the inhomogeneous storage stack. ESDM which provides a NetCDF compatible layer at a high-performance and portable-portable fashion. A selection of performance results is given and ongoing efforts for workflow support and active storage are discussed.