Patent Document ID: 20080082520
Application ID: 11540240
Patent Status: 0

Claim One:
1. A computer-implemented method for analyzing, on shared and distributed computing systems, information comprising one or more documents, the method comprising: Distributing one or more distinct sets of the documents among each of a plurality of processes, wherein each process performs operations on a distinct set of documents substantially in parallel with other processes; For each process: Computing term statistics for terms contained in each of the process' distinct sets of documents, thereby generating a local set of term statistics for each distinct set of documents; Contributing the local sets of term statistics to a global set of term statistics, wherein the global set of term statistics comprises an aggregate of the term statistics from all processes; and Participating in generating a major term set, wherein each process is assigned a portion of a global vocabulary and filters the terms in its assigned portion based on the global set of term statistics.