add more error checking for failure to get upstream job_id