Only Admins can remove users

Regular users can add other users, in team/self managed workspaces, but they cannot remove them.