Patent ID: 9646048
Date: 2017-05-09
CPC Classifications: G06F

Claim:
1. In a computing environment, a system comprising: one or more processors; a preprocessor engine, implemented using at least one of the one or more processors, configured to generate a data structure that indicates a plurality of chunks of data to obtain from one or more target data sources; a timing manager configured to determine one or more periods to wait, each period corresponding to a respective query of a plurality of queries, the timing manager configured to use a formula to compute at least a first period of the one or more periods; a query manager, implemented using at least one of the one or more processors, configured to generate the plurality of queries from a template, the plurality of queries including values derived from the data structure to indicate the plurality of chunks of the data, the query manager further configured to submit the plurality of queries to at least one of the one or more target data sources, the query manager configured to wait until the first period that corresponds to a first query of the plurality of queries expires to submit another query of the plurality of queries; and a persistence manager, implemented using at least one of the one or more processors, configured to save the plurality of chunks that are received in response to the plurality of queries to a local store.