Clean up created job upon failure only if it was actually created.