Patent ID: 9594637
Date: 2017-03-14
CPC Classifications: G06F

Claim:
1. A method to process parallel computing tasks on a distributed computing system, comprising: computing, by an integration application, an execution plan for a parallel computing job comprising a set of parallel processing operators to be executed on the distributed computing system, the distributed computing system comprising a plurality of compute nodes, each computing node having a distinct memory; generating, by the integration application, based on the execution plan, an ordered set of tasks specifying a sequence for executing the set of parallel processing operators of the parallel computing job on the distributed computing system, wherein each of the ordered set of tasks is a driver to at least one parallel processing operator of the set of parallel processing operators, wherein the at least one parallel processing operator is executed on the distributed computing system without modification, and wherein the ordered set of tasks comprises: (i) one or more configuration tasks, wherein each configuration task includes loading a dynamic library of the at least one parallel processing operator and creating at least one socket channel for communication between each configuration tasks and the at least one parallel processing operator, and (ii) one or more execution tasks for executing the at least one parallel processing operator; and launching a distributed computing application to assign the tasks of the ordered set of tasks to the plurality of compute nodes to execute the parallel computing job on the distributed computing system.