Simple binary for executing applications and collecting results to a collector service