Patent Document ID: 8175878
Application ID: 12968108

Base Claim:
1. A system comprising: a computer-readable storage medium including instructions; and data processing apparatus capable of executing the instructions to perform operations comprising: generating a compact language model, including: receiving a collection of n-grams from a corpus, each n-gram of the collection having a corresponding first probability of occurring in the corpus, and generating a trie representing the collection of n-grams including calculating a left word vector and a diversity count vector using the collection of n grams, the left word vector identifying each distinct left word for a given right context in the collection, the diversity count vector identifying a count of distinct left words for each right context in the collection, and using the language model to identify a second probability of a particular string of words occurring.

---

Claim 3:
3. The system of claim 1 in which generating the trie further comprises: calculating a left context vector identifying each distinct left word for each distinct context in the collection, a left diversity vector identifying a count of distinct left words for each context in the collection, a future word vector identifying each distinct predicted word for a given context in the collection, and a future diversity vector identifying a count of distinct predicted words for each context in the collection.