Update both X and Y when switching touch pointer.