We should use a different timeout than WORKER_TIMEOUT here, because that one is to detect failures. Maybe add another property called spark.deploy.recovery.timeout.