Don't crash if the user starts dragging an object that was draggable but had physics stopped