apache/spark — pull request #2343 by rxin (2014-09-10 06:34:44+00:00)
Title: [SPARK-3469] Call all TaskCompletionListeners even if some fail

This is necessary because we rely on this callback interface to clean resources up. The old behavior would lead to resource leaks.

Note that this also changes the fault semantics of TaskCompletionListener.
Previously failures in TaskCompletionListeners would result in the task
being reported as failed. With this change, tasks won't be reported as failed
simply because the execution of TaskCompletionListener fails.