Only write a failure if we haven't defined a _failures directory