Petabyte CephFS for Satellite Data Processing - DevConf.CZ 2020
Channel: DevConf
Date: 30/03/2020

Speakers: Martin Strigl

Imagine receiving every day about 7 Terrabyte of Earth Observation Satellite Data, that needs to be stored somewhere
Imagine that these data needs to be processed every day
Imagine that you are not always in control of the source code of the processing algorithms
Imagine that these data has a really huge amount of 30 Petabyte

There are not that much storage solutions out there which can fulfill these demands.

During the session I will present how our approach was in terms of:
- evaluating solutions
- evaluating hardware
- load and performance test solution
- bringing the beast to production and keeping it there

I will also tell you something about:
- problems we encountered (and their solution)
- our concrete usage patterns
- security implications and concerns

[ https://sched.co/YOwq ]

--
Recordings of talks at DevConf are a community effort. Unfortunately not everything works perfectly every time. If you're interested in helping us improve, let us know.