Improve swipe performance in touchmove event

There is no need to change the position of the slide out of the wrapper in touchmove event.