fix JS error, prevent trying to add or remove users who are already added/removed