fail on error to false on tests report directory and mkdir