Patent ID: 9239827
Filing Date: 2016-01-19
CPC Classification: G06F,G06Q

Claim Text:
1. A method executed by at least one computing device in a distributed computing environment, the method comprising: identifying n-grams of differing lengths in a corpus of text, the corpus of text comprising tokens arranged in an order, each identified n-gram comprises a plurality of sequential tokens in the corpus of text; for each n-gram identified in the corpus of text, identifying a prefix of the n-gram and a suffix of the n-gram; computing, for each identified n-gram in the corpus of text and in a single pass over the corpus of text, a metric that is indicative of a frequency of occurrence of the n-gram in the corpus of text relative to an expected frequency of occurrence of the n-gram in the corpus of text if the tokens were arranged randomly in the corpus of text, the metric computed based upon the identifying of the prefix of the n-gram and the suffix of the n-gram, the computing of the metric performed by the at least one computing device in the distributed computing environment; and when the metric is above a predefined threshold, assigning a label to the n-gram that indicates that the n-gram is representative of content of the corpus of text.