Patent ID: 8458348

Claim:
A method for processing data sets using multiple processors, the method comprising: receiving, by a computer system, a plurality of data sets, wherein: each data set comprises a plurality of records; each record comprises a plurality of fields; the pluralities of records from the plurality of data sets are, in total, referred to as the set of records; at least a subset of the plurality of records within each data set are linked with records within another data set; receiving, by the computer system, a plurality of constraints, wherein: each constraint of the plurality of constraints identifies a data relationship that requires a subset of the set of records to be processed by a same processing device; calculating, by the computer system, a plurality of final constraints, wherein: each final constraint of the plurality of final constraints is linked with a record; each final constraint of the plurality of final constraints is at least partially based on the plurality of constraints; and final constraints of the plurality of final constraints having a same value are linked with records that are to be processed by the same processing device; and distributing, by the computer system, at least partially based on the final constraint, the set of records to a plurality of processing devices for processing.