Adds smoother scrolling by maintaining a set of all down keys.