Apparently we need to be explicit about failure otherwise it will think the tests passed.