Patent ID: 8381016

Claim:
A method for fault tolerance management of workers nodes during map/reduce computing in a computing cluster, the method comprising: subdividing a computational problem into a set of sub-problems in a map/reduce module executing in memory by at least one processor of a computer, and mapping a selection of the sub-problems in the set to respective nodes in a computing cluster; directing processing of the sub-problems in the respective nodes and collecting results from completion of processing of the sub-problems in the respective nodes; determining a computation time to complete computation of all of the sub-problems; establishing a polling interval at which time the health of each of the nodes computing a corresponding sub-problem is assessed; upon detecting failed nodes during a time period prior to a final polling interval before completion of the computation of all of the sub-problems, restarting the respective sub-problems; upon determining that the final polling interval has commenced, identifying nodes still processing respective sub-problems and replicating sub-problems in the identified nodes; and, removing duplicate results collected for the replicated sub-problems and reducing the results into a result set for the problem.