Patent ID: 7865355
Filing Date: 2011-01-04
Classification: G06F

Abstract:
1. A method for identifying a language corresponding to a string of data, comprising: receiving a data string from memory, the data string comprising a string of code points defining characters of a language where one or more of the code point values corresponds to more than one distinct character set, the data string having been electronically stored in the memory; dividing the data string into a plurality of coded character sequences for each of a plurality of languages to represent the same number of characters in each language of the plurality of languages, wherein a length of one or more coded character sequences varies among different languages; analyzing the coded character sequences to calculate, for each of the plurality of languages, an overall probability that the data string corresponds to a particular language, the analyzing coded character sequences for each language including: comparing the calculated overall probabilities among the languages; and identifying a language as corresponding to the data string based on comparing the calculated overall probabilities.