Patent ID: 8606826
Filing Date: 2013-12-10
Classification: G06F

Abstract:
1. A computer implemented method, comprising: generating, in a system comprising one or more computers, a synonyms map from a corpus of documents, wherein: each document is associated with a document language, the document language representing a natural language of the document, the synonyms map maps each of a plurality of keys to one or more corresponding variants, each key is a common form word whose characters do not include diacritical marks, each of the one or more corresponding variants is a variant of the common form word each variant (i) being found in the corpus of documents, (ii) being determined based on one or more character conversion maps that each specify one or more output characters to which one or more corresponding input characters are mapped, and (iii) including one or more characters that include diacritical marks; and the synonyms map associates each variant of a key with: (i) two or more document languages, and (ii) a respective score for each of the two or more document languages, the score indicating a relative frequency of the variant in documents associated with the document language among all variants of the key for the document language.