Fix user count when adding and removing users