Patent ID: 6178396
Filing Date: 2001-01-23
Classification: G06F,G10L

Abstract:
A word/phrase classification processing method, comprising the steps of:performing a first clustering process by extracting ""V"" different words from text data as a one-dimensional sequence of a plurality of words, and separating a set of the ""V"" different words into ""C"" word classes;extracting a set of word class sequences in which all of the degrees of stickiness between contiguous word classes are equal to or more than a predetermined value, in a one-dimensional sequence of word classes concerning the text data generated based on the first clustering process;generating a one-dimensional sequence of words and tokens concerning the text data by corresponding a specific token to a word class sequence, searching a word sequence belonging to the word class sequence for the text data, and replacing the word sequence in the text data with a corresponding token;performing a second clustering process, by extracting different words and tokens from the one-dimensional sequence of words and tokens concerning the text data, and separating a set of extracted words and tokens into word/token classes; andperforming a third clustering process by extracting a word sequence corresponding to a token as a phrase, from word sequences included in the text data, replacing the token in the word/token class with the phrase, and separating the set of extracted words and phrases into word/phrase classes.