Fix race condition in get_cache_returns

 if you ask for the return right after starting the job then you get an OSError since the directory doesn't exist yet