Fix bug with not being able to rejoin channels we're kicked from