When setting auth without client connection, do not start connection