Patent ID: 8510097

Claim:
A computer implemented method, comprising: (A) recording in computer memory (a) computer readable instructions for performing text-characterization, (b) input data and (c) a finite state transducer that along each path (i) accepts on a first side an n-gram representing a text-characterization and (ii) outputs on a second side a sequence of symbols identifying one or more text-characterizations from a set of text-characterizations; (B) processing the computer readable instructions with a computer processor; (C) wherein the computer processor in processing the computer readable instructions: (a) applies the finite state transducer to the input data to identify n-grams of text-characterization in the input data accepted by the finite state transducer on the first side; (b) for each n-gram accepted by the finite state transducer on the first side, increments a frequency counter associated with the one or more text-characterizations in the set of text-characterizations; (c) assigns the input data one or more text-characterizations from the set of text-characterizations using the frequency counters associated therewith; wherein said assigning assigns the input data one or more text-characterizations from the set of text-characterizations with text-characterizations associated with frequency counters that are greater in value than text-characterizations associated with other frequency counters.