Update spark_ec2.py to use new spark-ec2 scripts
Fix swap variable name
Add option to start ganglia. Also enable Hadoop ports even if cluster type is
not mesos
Add an option to use the old scripts
Turn on ganglia by default
Adding an example with an OLAP roll-up
Streaming constructor which takes JavaSparkContext

It's sometimes helpful to directly pass a JavaSparkContext,
and take advantage of the various constructors available for that.
Merge pull request #447 from pwendell/streaming-constructor

Streaming constructor which takes JavaSparkContext
add as many fetch requests as we can, subject to maxBytesInFlight
Inline mergePair to look more like the narrow dep branch.

No functionality changes, I think this is just more consistent
given mergePair isn't called multiple times/recursive.

Also added a comment to explain the usual case of having two parent RDDs.
Increase DriverSuite timeout.
Handle Terminated to avoid endless DeathPactExceptions.

Credit to Roland Kuhn, Akka's tech lead, for pointing out this
various obvious fix, but StandaloneExecutorBackend.preStart's
catch block would never (ever) get hit, because all of the
operation's in preStart are async.

So, the System.exit in the catch block was skipped, and instead
Akka was sending Terminated messages which, since we didn't
handle, it turned into DeathPactException, which started
a postRestart/preStart infinite loop.
Merge pull request #449 from stephenh/longerdriversuite

Increase DriverSuite timeout.
Merge branch 'master' into fixdeathpactexception

Conflicts:
	core/src/main/scala/spark/deploy/worker/Worker.scala
Merge pull request #451 from stephenh/fixdeathpactexception

Handle Terminated to avoid endless DeathPactExceptions.
Merge pull request #450 from stephenh/inlinemergepair

Inline mergePair to look more like the narrow dep branch.
Add private, minor formatting.
Add RDD.coalesce.
Remove unneeded zipWithIndex.

Also rename r->rdd and remove unneeded extra type info.
Clean up RDDs, mainly to use getSplits.

Also made sure clearDependencies() was calling super, to ensure
the getSplits/getDependencies vars in the RDD base class get
cleaned up.