apache/spark — pull request #3264 by mengxr (2014-11-14 08:44:52+00:00)
Title: [SPARK-4398][PySpark] specialize sc.parallelize(xrange)

`sc.parallelize(range(1 << 20), 1).count()` may take 15 seconds to finish and the rdd object stores the entire list, making task size very large. This PR adds a specialized version for xrange.

@JoshRosen @davies