Check port before connecting, not on client creation