keep cacheSize with goAbsolute

This is a followup to f2e2f55ea230fa7b776c8faa6673b86d1c41a639