Extra check to prevent race condition in cancelling azkaban jobs.