Patent ID: 8832176
Filing Date: 2014-09-09
Classification: G06F

Abstract:
1. A computer-implemented method for processing data files, comprising: retrieving a first file processing job from a job list by a first file processing task of a plurality of file processing tasks, wherein the job list comprising file processing jobs is populated by a main task upon startup of the main task, and wherein the job list is further populated with dynamically listed file processing tasks, wherein the dynamically listed file processing tasks are entered into the job list through an application programming interface; decomposing the first file processing job to a plurality of sub-jobs by the first file processing task when a workload associated with the first file processing job exceeds a threshold; listing the plurality of the sub-jobs in the job list; monitoring timestamps associated with the file processing jobs in the job list of at least one result storage location by the first file processing task for results from execution of respective ones of the plurality of sub-jobs by one or more second file processing tasks; responsive to one of the timestamps, determining that a task to which a corresponding job is assigned is not responding; responsive to a request by a second file processing task, assigning the corresponding job to the second file processing task; recording the assignment of the job in the job list; detecting completion of the first processing job based upon the monitoring; and outputting a result for the first file processing job based upon the results from execution of respective ones of the plurality of sub-jobs.