Adjust a few behaviors on channel invite and part