Patent ID: 9317553
Filing Date: 2016-04-19
CPC Classification: G06F

Claim Text:
1. A method implemented at least in part by a computer, the method comprising: discovering one or more target data sources from which to obtain data; generating a data structure that indicates a plurality of chunks of the data to obtain from the one or more target data sources; generating a plurality of queries from a template, the plurality of queries including values derived from the data structure to indicate the plurality of respective chunks of the data; submitting a first query of the plurality of queries to one or more of the one or more target data sources; receiving a response to the first query, the response including a respective chunk of the plurality of chunks; storing the chunk in a local data store; determining a plurality of periods to wait, each period corresponding to a respective query of the plurality of queries, the determining comprising: in response to the first query completing, waiting until the period that corresponds to the first query expires to submit another query of the plurality of queries, the waiting comprising: performing the following operations for each subsequent query of the plurality of queries until the plurality of chunks is obtained: each period of the plurality of periods being determined prior to waiting until the respective period expires.