Patent ID: 6691166
Filing Date: 2004-02-10
Classification: G06F,H04L,Y10S

Abstract:
A distributive computer system for transferring a data set having a plurality of data rows between a first computer storage location and a second computer storage location, the system comprising:a plurality of communication nodes, coupling the first and second computer storage locations, each of the plurality of communication nodes serving as a communication thread; a data transfer controller, coupled to the first or second computer storage location and the plurality of communication nodes, to select a number of communication threads to serve as data transfer links between the first and second computer storage location; a data partitioner, coupled to the first computer storage location, that extends the data set by adding an additional column to the data set and assigning a persistent partition ID to each of the plurality of data rows in the additional column; and a selection mechanism responsive to a plurality of queries against the data set, wherein each query has conditions that select the same rows from the data set and each query has partition ID information that forms a different result set from the selected rows so that the result set of each query forms a transferable data set partition and wherein the data transfer controller transfers the data set partitions over the communication threads in parallel.