Only dispatch the drag events when the action button is pressed