Fix IrcChannelPrivate::set/clearUsers()