apache/spark — pull request #3101 by aarondav (2014-11-05 02:55:59+00:00)
Title: [SPARK-4238] [Core] Perform network-level retry of shuffle file fetches

This adds a RetryingBlockFetcher to the NettyBlockTransferService which is wrapped around our typical OneForOneBlockFetcher, adding retry logic in the event of an IOException.

This sort of retry allows us to avoid marking an entire executor as failed due to garbage collection or high network load.

TODO:
- [ ] unit tests
- [ ] put in ExternalShuffleClient too