Patent ID: 7809718

Claim:
A method of clustering a plurality of documents from a data stream comprising: identifying, by a processor, metadata in the plurality of documents; emphasizing, by the processor, one or more words corresponding to the metadata; generating, by the processor, a single feature vector for each of the plurality of documents based at least in part on the emphasized words by determining a numerical value for each word in one or more of the plurality of documents by determining a Term Frequency Inverse Document Frequency (TFIDF): TFIDF = ( TF TF + 0.5 + 1.5 · DL N 1 N · ∑ i = 1 N ⁢ DL i ) · ( log ⁡ ( N + 0.5 DF ) log ⁡ ( N + 1 ) ) wherein TF is the frequency of each word, N is a number of documents, DL i is a length of the i th document in words, and DF is the number of documents having each word; clustering, by the processor, the plurality of documents based at least in part on the generated feature vectors; and mining the data by removing stop words from one or more documents and determining frequencies of words remaining in the one or more documents.