Patent Document ID: 9990339
Application ID: 13443677

Base Claim:
1. A computer-implemented method for detecting character encodings of text streams, at least a portion of the method being performed by a computing device comprising at least one processor, the method comprising: identifying a request to identify a character encoding of a text stream; dividing the text stream to identify a plurality of n-grams within the text stream; identifying a plurality of vectors within a vector space, each vector representing a potential character encoding by a plurality of expected n-grams within the potential character encoding; generating, based at least in part on the plurality of n-grams within the text stream and based at least in part on an inverse frequency of appearance of each of the plurality of n-grams within the plurality of vectors, a representative vector describing the text stream; identifying the character encoding of the text stream based on identifying a similarity between the representative vector and a neighboring vector within the plurality of vectors representing the character encoding.

---

Claim 3:
3. The computer-implemented method of claim 1 , wherein: generating the representative vector describing the text stream comprises generating the representative vector based on the plurality of vectors being represented with a first dimensionality; identifying the similarity between the representative vector and the neighboring vector comprises identifying the similarity between the representative vector and the neighboring vector based on the plurality of vectors being represented with a second dimensionality that is smaller than the first dimensionality.