Patent ID: 8996469
Filing Date: 2015-03-31
Classification: G06F

Abstract:
1. A method, comprising: receiving, by a first compute node of a plurality of compute nodes on a cluster computing system, a state object for a respective job to be executed by a distributed application on the cluster computing system, wherein the state object is a relational database file that includes a job metadata database that stores status and history information for the respective job as executed by the distributed application on the plurality of compute nodes of the cluster computing system, wherein the cluster computing system comprises at least the plurality of compute nodes connected together through a network; sending, by the first compute node through the network, a location indicator for the state object on the first compute node to a state tracker at a second compute node of the plurality of compute nodes on the cluster computing system, the state tracker recording that the state object is located at the first compute node in a state object location database for the cluster computing system based upon receiving the location indicator; updating the job metadata database of the state object according to execution of one or more tasks of the job on the first compute node, the job metadata database being transferred as part of the state object when the respective job is transferred among the plurality of compute nodes; receiving, by the state tracker, a query requesting a location on the network of the state object; sending, by the state tracker, a response to the query, wherein the response includes the location indicator for the state object obtained from the state object location database, wherein the state object location database is updated according to the location indicator for the state object when the state object is transferred to another compute node of the cluster computing system; and querying, based on said sent response, the state object to obtain job metadata for the job, wherein the job metadata comprises job status and statistics associated with the job.