Fix peer connect race on stop