All duplicates must be present in the file for analysis