Fix switching in and out of connector mode

Broken by 9d3f55be5193763d4c6d2afc3ddecea0bf5a9f39