Patent ID: 9223779
Filing Date: 2015-12-29
Classification: G06F

Abstract:
1. A method of text processing, comprising: training a classifier for classifying text based on a plurality of training sample entries, building a lexicon of smallest semantic units, comprising: receiving a text to be translated, the text being in a first language; segmenting the received text based on the lexicon of smallest semantic units to obtain medium-grained segmentation results; merging the medium-grained segmentation results to obtain coarse-grained segmentation results, the coarse-grained segmentation results having coarser granularity than the medium-grained segmentation results; forming a word segmentation tree structure, wherein the received text is used to form a root node of the word segmentation tree structure, and a segment in the medium-grained segmentation results is used to form a sub-node of the root node; looking up in the lexicon of smallest semantic units respective search elements that correspond to segments in the medium-grained segmentation results; forming a leaf node in the word segmentation tree structure based at least in part on a corresponding search element; forming fine-grained segmentation results based on the respective search elements, the fine-grained segmentation results having finer granularity than the medium-grained segmentation results, and obtaining the leaf node as a fine-grained segmentation result; and translating, using a processor, the received text into a second language based on the fine-grained segmentation results, the second language being different from the first language.