Serialize and restore spark.cleaner.ttl to savepoint
Renamed StandaloneX to CoarseGrainedX.

The previous names were confusing because the components weren't just
used in Standalone mode -- in fact, the scheduler used for Standalone
mode is called SparkDeploySchedulerBackend. So, the previous names
were misleading.
Added back fully qualified class name
Merge pull request #29 from rxin/kill

Job killing

Moving https://github.com/mesos/spark/pull/935 here

The high level idea is to have an "interrupted" field in TaskContext, and a task should check that flag to determine if its execution should continue. For convenience, I provide an InterruptibleIterator which wraps around a normal iterator but checks for the interrupted flag. I also provide an InterruptibleRDD that wraps around an existing RDD.

As part of this pull request, I added an AsyncRDDActions class that provides a number of RDD actions that return a FutureJob (extending scala.concurrent.Future). The FutureJob can be used to kill the job execution, or waits until the job finishes.

This is NOT ready for merging yet. Remaining TODOs:

1. Add unit tests
2. Add job killing functionality for local scheduler (current job killing functionality only works in cluster scheduler)

-------------

Update on Oct 10, 2013:

This is ready!

Related future work:
- Figure out how to handle the job triggered by RangePartitioner (this one is tough; might become future work)
- Java API
- Python API
Update pom.xml to use version 13 of the ASF parent pom and add mailingLists element.
Bump up logging level to warning for failed tasks.
SPARK-627 - reading --config argument
Merge branch 'master' of https://github.com/apache/incubator-spark

Updating local branch
Merge pull request #58 from hsaputra/update-pom-asf

Update pom.xml to use version 13 of the ASF parent pom

Update pom.xml to use version 13 of the ASF parent pom.
Add mailingList element to pom.xml.
Merge pull request #59 from rxin/warning

Bump up logging level to warning for failed tasks.
Unified daemon thread pools
Merge remote branch 'upstream/master' into rename
Fixed build error after merging in master
Make TaskContext's stageId publicly accessible.
Fix line length > 100 chars in SparkHadoopWriter
Merge pull request #61 from kayousterhout/daemon_thread

Unified daemon thread pools

As requested by @mateiz in an earlier pull request, this refactors various daemon thread pools to use a set of methods in utils.scala, and also changes the thread-pool-creation methods in utils.scala to use named thread pools for improved debugging.
Merge pull request #34 from kayousterhout/rename

Renamed StandaloneX to CoarseGrainedX.

(as suggested by @rxin here https://github.com/apache/incubator-spark/pull/14)

The previous names were confusing because the components weren't just
used in Standalone mode.  The scheduler used for Standalone
mode is called SparkDeploySchedulerBackend, so referring to the base class
as StandaloneSchedulerBackend was misleading.
Merge pull request #8 from vchekan/checkpoint-ttl-restore

Serialize and restore spark.cleaner.ttl to savepoint

In accordance to conversation in spark-dev maillist, preserve spark.cleaner.ttl parameter when serializing checkpoint.
Proper formatting for SparkHadoopWriter class extensions.
Fixing spark streaming example and a bug in examples build.

- Examples assembly included a log4j.properties which clobbered Spark's
- Example had an error where some classes weren't serializable
- Did some other clean-up in this example