Patent ID: 11405482

Abstract:
A processor-implemented method for linking identifiers to generate a unique entity identifier for deduplicating high-speed data streams in real time, the method comprising (i) obtaining one or more data streams with an identifier from independently controlled entities, wherein the one or more data streams comprises timestamp data and location indexed data that partially characterizes an activity of an entity, (ii) determining home location or internet protocol address of the entity by analyzing data obtained from the one or more data streams, (iii) clustering entity devices based on an association between an internet protocol address, a real-time event, a period of time or a location, (iv) disambiguating the clusters of entity devices into sub-clusters that resolve to an entity by analyzing data streams until a candidate pair of identifiers is obtained, (v) generating score for the candidate pair using a machine learning classifier to discern the candidate pair of identifiers into to same or different entity, (vi) filtering the candidate pair of identifiers by comparing the score with a predetermined threshold value, (vii) evaluating filtered candidate pair of identifiers to generate a unique entity identifier for the entity, (viii) refining the unique entity identifier in real-time using a feedback loop based on a test engagement activity, and (ix) deduplicating one or more data streams that are associated with the unique entity identifier in real time by validating entity attributes linked with the unique entity identifier with the attributes observed in a first data stream and a second data stream of the test engagement activity.