Make sure CMSSW-not-found error is properly reported and retried.