Patent ID: 8595466

Claim:
A method, in a data processing system having a plurality of processing elements, for performing a portion of an All-to-All comparison of data elements operation, comprising: determining a number of data elements to be included in each set of data elements to be sent to each processing element of the plurality of processing elements; performing a comparison operation, of a portion of the All-to-All comparison of data elements operation assigned to a processing element, on at least one set of data elements, wherein the comparison operation comprises: sending, from the processing element, a first request to main memory for transfer of a first set of data elements into a local memory associated with the processing element; sending, from the processing element, a second request to main memory for transfer of a second set of data elements into the local memory; and performing a pair wise comparison computation of the portion of the All-to-All comparison of data elements operation using the first set of data elements transferred to the local memory associated with the processing element, at approximately a same time as the second set of data elements is being transferred from main memory to the local memory associated with the processing element; and storing results of the comparison operation in main memory of the data processing system, wherein determining the number of data elements to be included in each set of data elements to be sent to each processing element of the plurality of processing elements comprises: retrieving the number of data elements from a data structure based on a data element type of the data elements, wherein the data structure comprises a plurality of entries and each entry in the plurality of entries stores a number of data elements value in association with a corresponding data element type.