Fix case where dragging has initialized, but not yet actually started and has left the dragger hanging around.