An MPI-based C library for distributed and streamed batch processing