Smarter way to make dragging use the correct coord space