Patent ID: 7984045

Claim:
A computer-implemented method to be executed at least in part in a computing device for extracting data from a data store, comprising: receiving a request for extracting the data; generating an internal query based on at least one parameter associated with the request, wherein the at least one parameter comprises a packet size parameter, the packet size parameter comprising one or more of the following: environment variables, configuration items and registry entries, wherein the packet size parameter is adjusted during execution of the query based on query specified results; generating an extract code based on at least one parameter setting, the extract code including selection criteria and ordering information, the selection criteria comprising a plurality of rows of data from a data table, the ordering information comprising an order of primary key (PK) values in the data table; generating a set of conditions within the internal query based on available memory for data extraction and transfer, the set of conditions comprising a condition that portions of the data extracted as a result of the generated extract code do not exceed the available memory; extracting a batch of the data using the generated internal query; updating the set of conditions based on the extracted batch of the data and remaining available memory, wherein, when the extracted batch of data exceeds the remaining available memory, updating the set of conditions comprises tightening the set of conditions to select a smaller set of data, and when the remaining available memory is not fully utilized by the extracted batch of data, updating the set of conditions comprises relaxing the set of conditions for a subsequent extracted batch of data such that the remaining available memory is better utilized, wherein the PK values are utilized in generating a subsequent internal query for the subsequent extracted batch of data; and extracting another batch of the data using the generated internal query with the updated conditions.