Only disable click events on honest-to-goodness drag actions.