Camera smoothly moves to last drag direction