Touchend event should be listened once in swipe handler.