Fix alignment by not zeroing positions until mouse release