[SPARK-1285] Backporting updates to streaming docs to branch 0.9

Cherrypicked updates that have been added to master branch

Author: Aaron Kimball <aaron@magnify.io>
Author: Tathagata Das <tathagata.das1565@gmail.com>
Author: Chen Chao <crazyjvm@gmail.com>
Author: Andrew Or <andrewor14@gmail.com>

Closes #183 from tdas/branch-0.9-streaming-docs and squashes the following commits:

e1a988f [Tathagata Das] Added clean to run-tests
98c3e98 [Tathagata Das] Merge remote-tracking branch 'apache-github/branch-0.9' into branch-0.9-streaming-docs
d792351 [Chen Chao] maintain arbitrary state data for each key
e708f74 [Aaron Kimball] SPARK-1173. (#2) Fix typo in Java streaming example.
156bcd7 [Aaron Kimball] SPARK-1173. Improve scala streaming docs.
8849a96 [Andrew Or] Fix typos in Spark Streaming programming guide
fbd66a5 [Chen Chao] Merge pull request #579 from CrazyJvm/patch-1.
SPARK-1051. On YARN, executors don't doAs submitting user

This reopens https://github.com/apache/incubator-spark/pull/538 against the new repo

Author: Sandy Ryza <sandy@cloudera.com>

Closes #29 from sryza/sandy-spark-1051 and squashes the following commits:

708ce49 [Sandy Ryza] SPARK-1051. doAs submitting user in YARN
SPARK-1032. If Yarn app fails before registering, app master stays aroun...

...d long after

This reopens https://github.com/apache/incubator-spark/pull/648 against the new repo.

Author: Sandy Ryza <sandy@cloudera.com>

Closes #28 from sryza/sandy-spark-1032 and squashes the following commits:

5953f50 [Sandy Ryza] SPARK-1032. If Yarn app fails before registering, app master stays around long after

Conflicts:
	yarn/alpha/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala
	yarn/stable/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala
Bumped versions to Spark 0.9.1

Self explanatory!

Author: Tathagata Das <tathagata.das1565@gmail.com>

Closes #190 from tdas/branch-0.9-version-bump and squashes the following commits:

34576ee [Tathagata Das] Bumped versions to Spark 0.9.1
Removed incubating from Spark version in all the pom.xml.
Merge branch 'branch-0.9' of github.com:apache/spark into csd-2.10

Conflicts:
	assembly/pom.xml
	bagel/pom.xml
	core/pom.xml
	examples/pom.xml
	external/flume/pom.xml
	external/kafka/pom.xml
	external/mqtt/pom.xml
	external/twitter/pom.xml
	external/zeromq/pom.xml
	graphx/pom.xml
	mllib/pom.xml
	pom.xml
	python/pyspark/shell.py
	repl/pom.xml
	streaming/pom.xml
	tools/pom.xml
	yarn/pom.xml