Backend for processing the nightly data dump and pushing it to the frontend