Compile a binary to run all tests at once.