Update cache to keep more than one version of a package