runner: try several times to run a benchmark

also log errors in separate files