statistics: dump failed if there was an error with a whole file
fail-only: if a module fails, run all of the tests in it