All failing checks are no longer cached
Simplify cleanup on deleting