Patent ID: 8433702
Filing Date: 2013-04-30
Classification: G06F

Abstract:
1. A method of identifying distinct values that occur at or above a threshold frequency within a data set, the method comprising: allocating a number of count storage buckets, wherein a function of the threshold frequency determines how many count storage buckets to allocate; performing a counting operation on a particular subset of the data set by, for each item of the particular subset: selecting, for the particular subset of the data set, a candidate set of distinct values and associated counts from the distinct values that are associated with the count storage buckets after the counting operation; selecting a plurality of candidate sets of distinct values and associated counts by repeating at least the counting operation and the selecting of the candidate set for each particular subset of a plurality of non-overlapping subsets of the data set; forming a merged candidate set of distinct values by merging the plurality of candidate sets based on the associated counts; for each distinct value in the merged candidate set, determining a frequency of occurrence of the distinct value within the data set; identifying a set of high-frequency distinct values by comparing the frequency of occurrence of each distinct values in the merged candidate set with the threshold frequency; wherein the method is performed by one or more computing devices.