Stop trying to cache the oldest reader: we only use it for eviction and only update it when required.