Patent ID: 8150889
Filing Date: 2012-04-03
Classification: G06F

Abstract:
1. A method of loading data across a cluster of nodes, comprising: receiving a request to load data into a system comprising a plurality of nodes, each node having storage associated therewith for storing at least a portion of the data; selecting at least a subset of the plurality of nodes to each load a portion of the data; queuing a plurality of jobs to be processed by the subset of nodes, each job causing a portion of the data to be loaded into the storage of the node processing the job; and causing each node in the subset to dequeue any of the plurality of jobs as soon as the node is able to process one of the queued jobs, such that at least a portion of the queued jobs are processed in parallel across the subset of nodes and each job is processed as soon as any node in the subset is able to process the job.