Patent ID: 8732720

Claim:
A method, comprising: generating, by a processor, a performance model for each of plurality of jobs, wherein each job comprises a plurality of map tasks and a plurality of reduce tasks, wherein the map tasks produce intermediate results based on segments of input data, and the reduce tasks produce outputs based on the intermediate results, the performance model comprising an execution duration for a map stage estimated based on execution of the map tasks by plurality of map slots and an execution duration for a reduce stage estimated based on execution of the reduce tasks by a plurality of reduce slots; associating each of the jobs with one of a map stage group and a reduce stage group based on which of the map stage and the reduce stage of the job is of lower execution duration; sorting the map stage group by increasing map stage duration value; sorting the reduce stage group by decreasing reduce stage duration value; and appending the reduce stage group to the map stage group to form an execution order for the jobs.