Avoid swapping object when dragging