Don't adjust scrollIndicatorInsets when not visible.