Only kick users from channels they are actually in