Manually keep track of last x and last y instead of using getHistoricalX and getHistoricalY