apache/spark — pull request #2152 by davies (2014-08-27 01:08:43+00:00)
Title: [SPARK-3239] [PySpark] randomize the dirs for each process

This can avoid the IO contention during spilling, when you have multiple disks.