Fixed bug with removing user: if not on channel silently ignore.