Move more expensive cache check to async task

I'd rather randomize the recheck by a factor of days than remove the trigger points for it.