Patent Document ID: 7720673
Application ID: 11710098

Base Claim:
1. A method of language modeling of a document comprising: computing, by a computer processor, a plurality of local probabilities of a current document; determining a vector representation of the current document in a latent semantic analysis (LSA) space at a first time based on a first number of words present in the current document from a second time to the first time, wherein the second time precedes the first time; computing, by a computer processor, a plurality of global probabilities based upon the vector representation of the current document in an LSA space; and combining the local probabilities and the global probabilities to produce a language modeling.

---

Claim 10:
10. The method of claim 1 wherein the vector representation of the current document in an LSA space, {tilde over (v)}, at the first time q, wherein n q is a total number of words in the current document, i p is an index of a word observed at time p, ε i p is a normalized entropy of the word observed at time p within a text T, 0<λ≦1, μ i p is a left singular vector at time p of the singular value decomposition of W, and S is a diagonal matrix of singular values of a singular value decomposition of W, is as: v ~ = 1 n q ⁢ ∑ p = 1 q ⁢ λ ( nq - np ) ⁡ ( 1 - ɛ i p ) ⁢ u i p ⁢ S - 1 .