use set to keep track of current local files to be added, to filter out duplicates