Have CLI check job cache

Fixes an issue wherein returns might be missing from the CLI because of
a race condition between find_job and the timeout.