upload with remove duplicates