Have CLI check job cache

Fixes an issue wherein returns might be missing from the CLI because of
a race condition between find_job and the timeout.
Merge pull request #15123 from cachedout/cli_check_cache

Have CLI check job cache