a more granular user adding/removing system