Make sure we don't reconnect until we finish closing.