apache/incubator-spark — pull request #472 by CodingCat (2014-01-19 19:56:32+00:00)
Title: Set the upper bound for retry number of drivers

The main change is to add a configurable parameter spark.driver.maxretrynum which limits the number of retry when the driver program failed,

In worker, if the driver has tried for spark.driver.maxretrynum times and still failed to run, the master will receive the notification (DriverStateChanged)

If the driver state is ERROR or FAILED, and the driver still has chance to run on another worker (i.e. if the retry number hasn't been over the number of workers or configured maxretrynum), the driver will be relaunched to the other worker

In this implementation, the updated retry number of the driver is not written to the file by persistenceEngine (to avoid too many IO operations). Also the structure recording which workers the driver has been assigned to is also ignored by persistenceEngine