don't always mkdir
Loop benchmarks, and ignore failures from memory and busspeed tests