Move restoring prefetch cache out of fetchReplacement, where it seems out of place