Make connect safe to call repeatedly, also user errors only warrant warnings
We only use best point-of-gaze for now