Patent ID: 8832041

Claim:
A computer-implemented method for identifying duplicate entries within a set of entries, the method comprising: receiving the set of entries, wherein each entry comprises a set of field values associated with field types, the set of field values comprising non-blank field values; calculating a hash value for plural ones of the non-blank field values in at least a subset of the set of entries; determining that a hash value of a first field value in a first entry corresponds to a hash value of a second field value in a second entry, wherein the first field value and the second field value comprise non-blank field values; determining that each non-blank field value in the first entry does not conflict with each non-blank field value in the second entry by: determining that a first field type cannot accommodate multiple different field values for a single entry, the first field type defining a type of data stored in an associated field value; calculating a sequence alignment between a field value of the first field type in the first entry and a field value of the first field type in the second entry; and determining, based on the calculated sequence alignment being greater than a sequence alignment threshold, that the first field type is not associated with different non-blank field values in the first entry and the second entry; and providing, in response to determining that each non-blank field value in the first entry does not conflict with each non-blank field value in the second entry, an indication that the first entry and the second entry comprise duplicate entries.