Fix de-association of users to channels