Disconnect the IRC server when parting from the last channel/1on1