[SPARK-1285] Backporting updates to streaming docs to branch 0.9

Cherrypicked updates that have been added to master branch

Author: Aaron Kimball <aaron@magnify.io>
Author: Tathagata Das <tathagata.das1565@gmail.com>
Author: Chen Chao <crazyjvm@gmail.com>
Author: Andrew Or <andrewor14@gmail.com>

Closes #183 from tdas/branch-0.9-streaming-docs and squashes the following commits:

e1a988f [Tathagata Das] Added clean to run-tests
98c3e98 [Tathagata Das] Merge remote-tracking branch 'apache-github/branch-0.9' into branch-0.9-streaming-docs
d792351 [Chen Chao] maintain arbitrary state data for each key
e708f74 [Aaron Kimball] SPARK-1173. (#2) Fix typo in Java streaming example.
156bcd7 [Aaron Kimball] SPARK-1173. Improve scala streaming docs.
8849a96 [Andrew Or] Fix typos in Spark Streaming programming guide
fbd66a5 [Chen Chao] Merge pull request #579 from CrazyJvm/patch-1.
SPARK-1051. On YARN, executors don't doAs submitting user

This reopens https://github.com/apache/incubator-spark/pull/538 against the new repo

Author: Sandy Ryza <sandy@cloudera.com>

Closes #29 from sryza/sandy-spark-1051 and squashes the following commits:

708ce49 [Sandy Ryza] SPARK-1051. doAs submitting user in YARN
SPARK-1032. If Yarn app fails before registering, app master stays aroun...

...d long after

This reopens https://github.com/apache/incubator-spark/pull/648 against the new repo.

Author: Sandy Ryza <sandy@cloudera.com>

Closes #28 from sryza/sandy-spark-1032 and squashes the following commits:

5953f50 [Sandy Ryza] SPARK-1032. If Yarn app fails before registering, app master stays around long after

Conflicts:
	yarn/alpha/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala
	yarn/stable/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala
Bumped versions to Spark 0.9.1

Self explanatory!

Author: Tathagata Das <tathagata.das1565@gmail.com>

Closes #190 from tdas/branch-0.9-version-bump and squashes the following commits:

34576ee [Tathagata Das] Bumped versions to Spark 0.9.1
Removed incubating from Spark version in all the pom.xml.
[SPARK-1273] use doi links in mllib-guide

Author: Xiangrui Meng <meng@databricks.com>

Closes #198 from mengxr/branch-0.9 and squashes the following commits:

39c74ff [Xiangrui Meng] use doi links in mllib-guide
SPARK-1284: Fix improper use of SimpleDateFormat

`SimpleDateFormat` is not thread-safe. Some places use the same SimpleDateFormat object without safeguard in the multiple threads. It will cause that the Web UI displays improper date.

This PR creates a new `SimpleDateFormat` every time when it's necessary. Another solution is using `ThreadLocal` to store a `SimpleDateFormat` in each thread. If this PR impacts the performance, I can change to the latter one.

Author: zsxwing <zsxwing@gmail.com>

Closes #179 from zsxwing/SPARK-1278 and squashes the following commits:

21fabd3 [zsxwing] SPARK-1278: Fix improper use of SimpleDateFormat

Conflicts:

	core/src/main/scala/org/apache/spark/scheduler/JobLogger.scala
	core/src/main/scala/org/apache/spark/ui/jobs/JobProgressUI.scala
	core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala
	core/src/main/scala/org/apache/spark/ui/jobs/StageTable.scala
	core/src/main/scala/org/apache/spark/util/FileLogger.scala
Fix to Stage UI to display numbers on progress bar

Fixes an issue on Stage UI to display numbers on progress bar which are today hidden behind the progress bar div. Please refer to the attached images to see the issue.
![screen shot 2014-03-21 at 4 48 46 pm](https://f.cloud.github.com/assets/563652/2489083/8c127e80-b153-11e3-807c-048ebd45104b.png)
![screen shot 2014-03-21 at 4 49 00 pm](https://f.cloud.github.com/assets/563652/2489084/8c12cf5c-b153-11e3-8747-9d93ff6fceb4.png)

Author: Emtiaz Ahmed <emtiazahmed@gmail.com>

Closes #201 from emtiazahmed/master and squashes the following commits:

a7964fe [Emtiaz Ahmed] Fix to Stage UI to display numbers on progress bar

(cherry picked from commit 646e55405b433fdedc9601dab91f99832b641f87)
Signed-off-by: Aaron Davidson <aaron@databricks.com>
Updated CHANGES.txt file.
Removed all occurences of incubator from all the pom.xml.
[maven-release-plugin] prepare release v0.9.1-rc1
[maven-release-plugin] prepare for next development iteration
Revert "[maven-release-plugin] prepare for next development iteration"

This reverts commit 12e237e4bc8a307db3b823d8705cb1e28569c461.
Revert "[maven-release-plugin] prepare release v0.9.1-rc1"

This reverts commit 81c6a06c796a87aaeb5f129f36e4c3396e27d652.
[SPARK-782] Made Spark use existing shaded ASM and removed Spark's ASM dependency

This ports the changes in #100 to branch 0.9. However, unlike that PR, it does not exclude ASM from all dependencies of Spark, to ensure compatibility in branch 0.9.

Author: Tathagata Das <tathagata.das1565@gmail.com>

Closes #232 from tdas/asm and squashes the following commits:

999bb6f [Tathagata Das] Made Spark use existing shaded ASM and removed Spark's ASM depedency.
Updated CHANGES.txt
[maven-release-plugin] prepare release v0.9.1-rc2
[maven-release-plugin] prepare for next development iteration
SPARK-1322, top in pyspark should sort result in descending order.

Author: Prashant Sharma <prashant.s@imaginea.com>

Closes #235 from ScrapCodes/SPARK-1322/top-rev-sort and squashes the following commits:

f316266 [Prashant Sharma] Minor change in comment.
58e58c6 [Prashant Sharma] SPARK-1322, top in pyspark should sort result in descending order.
[SPARK-1327] GLM needs to check addIntercept for intercept and weights

GLM needs to check addIntercept for intercept and weights. The current implementation always uses the first weight as intercept. Added a test for training without adding intercept.

JIRA: https://spark-project.atlassian.net/browse/SPARK-1327

Author: Xiangrui Meng <meng@databricks.com>

Closes #236 from mengxr/glm and squashes the following commits:

bcac1ac [Xiangrui Meng] add two tests to ensure {Lasso, Ridge}.setIntercept will throw an exceptions
a104072 [Xiangrui Meng] remove protected to be compatible with 0.9
0e57aa4 [Xiangrui Meng] update Lasso and RidgeRegression to parse the weights correctly from GLM mark createModel protected mark predictPoint protected
d7f629f [Xiangrui Meng] fix a bug in GLM when intercept is not used

(cherry picked from commit d679843a39bb4918a08a5aebdf113ac8886a5275)
Signed-off-by: Tathagata Das <tathagata.das1565@gmail.com>