Don't allow fling remove, drag on long press