Make test runner failure report configurable