Removed repetative import; fixes hidden definition compiler warning.
Construct shell commands as sequences for safety and composability
Generate new SSH key for the cluster, make "--identity-file" optional
Remove MemoryStore$Entry.dropPending, unused as of 42e0a68082.
Clarify error messages on SSH failure
Set currentMemory to 0 in clear().
Remove unnecessary entries.get() call.
Start of working on SPARK-615
Make mapPartitionsWithIndex work with JavaRDD's
Merge branch 'master' of https://github.com/mesos/spark
Fix build on ubuntu
Merge branch 'master' of github.com:mesos/spark
Fix issue when local properties pass from parent to child thread
After unit tests, clear port properties unconditionally

In MapOutputTrackerSuite, the "remote fetch" test sets spark.driver.port
and spark.hostPort, assuming that they will be cleared by
LocalSparkContext. However, the test never sets sc, so it remains null,
causing LocalSparkContext to skip clearing these properties. Subsequent
tests therefore fail with java.net.BindException: "Address already in
use".

This commit makes LocalSparkContext clear the properties even if sc is
null.
Synchronize on "entries" the remaining update to "currentMemory".
Make "currentMemory" @volatile, so that it's reads in ensureFreeSpace() are atomic and up-to-date--i.e., currentMemory can't increase while putLock is held (though it could decrease, which would only help ensureFreeSpace()).
Smarter take/limit implementation.
Add "org.apache." prefix to packages in spark-class

Lacking this, the if/case statements never trigger on Spark 0.8.0+.
Add barrier for local properties unit test and fix some styles
Split HadoopRDD into one for general Hadoop datasets and one tailored to Hadoop files, which is a common case.

This is the first step to avoiding unnecessary Configuration broadcasts per HadoopRDD instantiation.
Merge pull request #940 from ankurdave/clear-port-properties-after-tests

After unit tests, clear port properties unconditionally
Merge pull request #941 from ilikerps/master

Add "org.apache." prefix to packages in spark-class