Ensure failed jobs and early notifications aren't run