This fails because `#handleFailedTask` accounts for job retries. If you explicitly set the job's retries to 0, from the default of 2, this will pass. This was fixed in my `persistent-metrics` branch as can be seen here: [https://github.com/airbnb/chronos/commit/6cde70b376c8f873bcdfe9b4bf1f9067c640222b#L13L53](https://github.com/airbnb/chronos/commit/6cde70b376c8f873bcdfe9b4bf1f9067c640222b#L13L53)