Only initialize from the cache if within timeout