Handle fling direction change