Stop without triggering the reconnect dialog