Fix broken drag arrow

When users try to change the start point after
grabing the end point, the arrow stays connected