Merge pull request #476 from tdas/streaming

Major modifications to fix driver fault-tolerance with file input stream
Use RDD type for `foreach` operator in Java.
Use RDD type for `transform` operator in Java.

This is an improved implementation of the `transform` operator in Java.
The main difference is that this allows all four possible types of
transform functions

1. JavaRDD -> JavaRDD
2. JavaRDD -> JavaPairRDD
3. JavaPairRDD -> JavaPairRDD
4. JavaPairRDD -> JavaRDD

whereas previously only (1) and (3) were possible.

Conflicts:

	streaming/src/test/java/spark/streaming/JavaAPISuite.java
Use RDD type for `slice` operator in Java.

This commit uses the RDD type in `slice`, making it available to both normal
and pair RDD's in java. It also updates the signature for `slice` to match
changes in the Scala API.
Small changes that were missing in merge
Merge pull request #481 from pwendell/stream-rdd-type-streaming

STREAMING-51: Add RDD type as a type parameter in JavaDStreamLike Edit (streaming/ version)
Paranoid uncaught exception handling for exceptions during shutdown
Catch/log errors deleting temp dirs
Added a method to create PartitionPruningRDD.
Fixes link to issue tracker in documentation page "Contributing to Spark".
Merge pull request #483 from rxin/splitpruningrdd2

Added a method to create PartitionPruningRDD.
Merge pull request #484 from andyk/master

Fixes a broken link in documentation to issue tracker
Pull detection of being in a shutdown hook into utility function.
Merge pull request #482 from woggling/shutdown-exceptions

Don't call System.exit over uncaught exceptions from shutdown hooks
A bug fix post merge, following changes to AkkaUtils
Merge pull request #486 from ScrapCodes/akka-example-bug-fix

A bug fix to AkkaWordCount example.
Merge branch 'mesos-master' into streaming
Fixed bug in CheckpointSuite
Merge branch 'mesos-streaming' into streaming

Conflicts:
	streaming/src/test/java/spark/streaming/JavaAPISuite.java