Allow cache to be persisted through --cache-path