Fix autoscroll affect by user interact.