Now do a chdir (in a temp directory) before running benchmarks, and writes stdout/stderr into files.