Patent ID: 8126909

Claim:
A computer-implemented method of analyzing data records, comprising: storing the data records in one or more data centers; allocating groups of the stored data records to respective processes of a first plurality of processes executing in parallel; after allocating the groups of the stored data records to the respective processes of the first plurality of processes executing in parallel, in each respective process of the first plurality of processes: for each data record in at least a subset of the group of the stored data records allocated to the respective process: creating a parsed representation of the data record; applying a query to the parsed representation of the data record to extract one or more values, wherein the query is applied independently to each parsed representation; and applying a respective emit operator to at least one of the extracted one or more values to add corresponding information to a respective intermediate data structure, wherein the respective emit operator implements one of a predefined set of application-independent statistical information processing functions; in each process of a second plurality of processes, aggregating information from a subset of the intermediate data structures to produce aggregated data; and combining the produced aggregated data to produce output data.