Use less instances of the random class during ALS setup
Code review feedback :)
move yarn to its own directory
remove core/src/hadoop{1,2} dirs
dynamically detect hadoop version
yarn sbt
remove hadoop-yarn's org/apache/...
add comment
yarn support
rename HadoopMapRedUtil => SparkHadoopMapRedUtil, HadoopMapReduceUtil => SparkHadoopMapReduceUtil
make SparkHadoopUtil a member of SparkEnv
SparkEnv isn't available this early, and not needed anyway
re-enable YARN support
YARN ApplicationMaster shouldn't wait forever
update YARN docs
Fix newTaskAttemptID to work under YARN
Rename HadoopWriter to SparkHadoopWriter since it's outside of our package
Update default version of Hadoop to 1.2.1
Fix
Implementing SPARK-878 for PySpark: adding zip and egg files to context and passing it down to workers which add these to their sys.path