Only add unique ids to list of users to lookup