Only listen for mousemove/mouseleave/mouseup events when the Contacts jumper is actually scrolling