Remove draggable if not owner