Ensure internal scroll values are up to date during refresh, fixes #100