Fixes an issue where number dragging would cause the scrollview to scroll all the way to the bottom on every frame.