remove the /benchmarks directory if it exists