A computer-implemented method, comprising: receiving, at a backup control node connected to a primary control node and a worker node on a communications grid, grid status information, the grid status information including a project status of the primary control node or a project status of the worker node, wherein the project status of the primary control node and the project status of the worker node include a status of one or more portions of a project being executed by the primary and worker nodes in the communications grid, and wherein the grid status information includes a project checkpoint that indicates a point during execution of a portion of the project prior to failure of the primary control node; storing the grid status information within the backup control node; receiving a failure communication including an indication that the primary control node has failed; designating the backup control node as a new primary control node based on the failure communication upon receiving the failure communication; receiving updated grid status information based on the indication that the primary control node has failed, wherein the updated grid status information includes an updated project status of the primary control node or an updated project status of the worker node; determining that the primary control node failed while the project was pending; and transmitting a set of instructions based on the updated grid status information, wherein the set of instructions includes the project checkpoint that indicates the point during the execution of a portion of the project prior to the failure of the primary control node, and wherein the set of instructions includes instructions for the worker nodes to continue work on the pending project from the project checkpoint after failure of the primary control node. receiving, at a backup control node connected to a primary control node and a worker node on a communications grid, grid status information, the grid status information including a project status of the primary control node or a project status of the worker node, wherein the project status of the primary control node and the project status of the worker node include a status of one or more portions of a project being executed by the primary and worker nodes in the communications grid, and wherein the grid status information includes a project checkpoint that indicates a point during execution of a portion of the project prior to failure of the primary control node; storing the grid status information within the backup control node; receiving a failure communication including an indication that the primary control node has failed; designating the backup control node as a new primary control node based on the failure communication upon receiving the failure communication; receiving updated grid status information based on the indication that the primary control node has failed, wherein the updated grid status information includes an updated project status of the primary control node or an updated project status of the worker node; determining that the primary control node failed while the project was pending; and transmitting a set of instructions based on the updated grid status information, wherein the set of instructions includes the project checkpoint that indicates the point during the execution of a portion of the project prior to the failure of the primary control node, and wherein the set of instructions includes instructions for the worker nodes to continue work on the pending project from the project checkpoint after failure of the primary control node.