[maven-release-plugin] prepare release v1.0.0-rc6
[maven-release-plugin] prepare for next development iteration
Fix: sbt test throw an java.lang.OutOfMemoryError: PermGen space

Author: witgo <witgo@qq.com>

Closes #773 from witgo/sbt_javaOptions and squashes the following commits:

26c7d38 [witgo] Improve sbt configuration

(cherry picked from commit fde82c1549c78f1eebbb21ec34e60befbbff65f5)
Signed-off-by: Reynold Xin <rxin@apache.org>
SPARK-1829 Sub-second durations shouldn't round to "0 s"

As "99 ms" up to 99 ms
As "0.1 s" from 0.1 s up to 0.9 s

https://issues.apache.org/jira/browse/SPARK-1829

Compare the first image to the second here: http://imgur.com/RaLEsSZ,7VTlgfo#0

Author: Andrew Ash <andrew@andrewash.com>

Closes #768 from ash211/spark-1829 and squashes the following commits:

1c15b8e [Andrew Ash] SPARK-1829 Format sub-second durations more appropriately

(cherry picked from commit a3315d7f4c7584dae2ee0aa33c6ec9e97b229b48)
Signed-off-by: Reynold Xin <rxin@apache.org>
SPARK-1833 - Have an empty SparkContext constructor.

This is nicer than relying on new SparkContext(new SparkConf())

Author: Patrick Wendell <pwendell@gmail.com>

Closes #774 from pwendell/spark-context and squashes the following commits:

ef9f12f [Patrick Wendell] SPARK-1833 - Have an empty SparkContext constructor.
(cherry picked from commit 65533c7ec03e7eedf5cd9756822863ab6f034ec9)

Signed-off-by: Patrick Wendell <pwendell@gmail.com>
[FIX] do not load defaults when testing SparkConf in pyspark

The default constructor loads default properties, which can fail the test.

Author: Xiangrui Meng <meng@databricks.com>

Closes #775 from mengxr/pyspark-conf-fix and squashes the following commits:

83ef6c4 [Xiangrui Meng] do not load defaults when testing SparkConf in pyspark

(cherry picked from commit 94c6c06ea13032b80610b3f54401d2ef2aa4874a)
Signed-off-by: Reynold Xin <rxin@apache.org>
[SPARK-1696][MLLIB] use alpha in dense dspr

It doesn't affect existing code because only `alpha = 1.0` is used in the code.

Author: Xiangrui Meng <meng@databricks.com>

Closes #778 from mengxr/mllib-dspr-fix and squashes the following commits:

a37402e [Xiangrui Meng] use alpha in dense dspr

(cherry picked from commit e3d72a74ad007c2bf279d6a74cdaca948bdf0ddd)
Signed-off-by: Reynold Xin <rxin@apache.org>
[Typo] propertes -> properties

Author: andrewor14 <andrewor14@gmail.com>

Closes #780 from andrewor14/submit-typo and squashes the following commits:

e70e057 [andrewor14] propertes -> properties

(cherry picked from commit 9ad096d55a3d8410f04056ebc87dbd8cba391870)
Signed-off-by: Reynold Xin <rxin@apache.org>
[SPARK-1826] fix the head notation of package object dsl

Author: wangfei <scnbwf@yeah.net>

Closes #765 from scwf/dslfix and squashes the following commits:

d2d1a9d [wangfei] Update package.scala
66ff53b [wangfei] fix the head notation of package object dsl

(cherry picked from commit 44165fc91a31e6293a79031c89571e139d2c5356)
Signed-off-by: Reynold Xin <rxin@apache.org>
default task number misleading in several places

  private[streaming] def defaultPartitioner(numPartitions: Int = self.ssc.sc.defaultParallelism){
    new HashPartitioner(numPartitions)
  }

it represents that the default task number in Spark Streaming relies on the variable defaultParallelism in SparkContext, which is decided by the config property spark.default.parallelism

the property "spark.default.parallelism" refers to https://github.com/apache/spark/pull/389

Author: Chen Chao <crazyjvm@gmail.com>

Closes #766 from CrazyJvm/patch-7 and squashes the following commits:

0b7efba [Chen Chao] Update streaming-programming-guide.md
cc5b66c [Chen Chao] default task number misleading in several places

(cherry picked from commit 2f639957f0bf70dddf1e698aa9e26007fb58bc67)
Signed-off-by: Reynold Xin <rxin@apache.org>
[SPARK-1840] SparkListenerBus prints out scary error message when terminated normally

Running SparkPi example gave this error.
```
Pi is roughly 3.14374
14/05/14 18:16:19 ERROR Utils: Uncaught exception in thread SparkListenerBus
scala.runtime.NonLocalReturnControl$mcV$sp
```
This is due to the catch-all in the SparkListenerBus, which logged control throwable used by scala system

Author: Tathagata Das <tathagata.das1565@gmail.com>

Closes #783 from tdas/controlexception-fix and squashes the following commits:

a466c8d [Tathagata Das] Ignored control exceptions when logging all exceptions.
(cherry picked from commit ad4e60ee7e2c49c24a9972312915f7f7253c7679)

Signed-off-by: Patrick Wendell <pwendell@gmail.com>
Add language tabs and Python version to interactive part of quick-start

This is an addition of some stuff that was missed in https://issues.apache.org/jira/browse/SPARK-1567. I've also updated the doc to show submitting the Python application with spark-submit.

Author: Matei Zaharia <matei@databricks.com>

Closes #782 from mateiz/spark-1567-extra and squashes the following commits:

6f8f2aa [Matei Zaharia] tweaks
9ed9874 [Matei Zaharia] tweaks
ae67c3e [Matei Zaharia] tweak
b303ba3 [Matei Zaharia] tweak
1433a4d [Matei Zaharia] Add language tabs and Python version to interactive part of quick-start guide
(cherry picked from commit f10de042b8e86adf51b70bae2d8589a5cbf02935)

Signed-off-by: Patrick Wendell <pwendell@gmail.com>
Documentation: Encourage use of reduceByKey instead of groupByKey.

Author: Patrick Wendell <pwendell@gmail.com>

Closes #784 from pwendell/group-by-key and squashes the following commits:

9b4505f [Patrick Wendell] Small fix
6347924 [Patrick Wendell] Documentation: Encourage use of reduceByKey instead of groupByKey.
(cherry picked from commit 21570b463388194877003318317aafd842800cac)

Signed-off-by: Patrick Wendell <pwendell@gmail.com>
Package docs

This is a few changes based on the original patch by @scrapcodes.

Author: Prashant Sharma <prashant.s@imaginea.com>
Author: Patrick Wendell <pwendell@gmail.com>

Closes #785 from pwendell/package-docs and squashes the following commits:

c32b731 [Patrick Wendell] Changes based on Prashant's patch
c0463d3 [Prashant Sharma] added eof new line
ce8bf73 [Prashant Sharma] Added eof new line to all files.
4c35f2e [Prashant Sharma] SPARK-1563 Add package-info.java and package.scala files for all packages that appear in docs
(cherry picked from commit 46324279dae2fa803267d788f7c56b0ed643b4c8)

Signed-off-by: Patrick Wendell <pwendell@gmail.com>
fix different versions of commons-lang dependency and apache/spark#746 addendum

Author: witgo <witgo@qq.com>

Closes #754 from witgo/commons-lang and squashes the following commits:

3ebab31 [witgo] merge master
f3b8fa2 [witgo] merge master
2083fae [witgo] repeat definition
5599cdb [witgo] multiple version of sbt  dependency
c1b66a1 [witgo] fix different versions of commons-lang dependency
(cherry picked from commit bae07e36a6e0fb7982405316646b452b4ff06acc)

Signed-off-by: Patrick Wendell <pwendell@gmail.com>
Revert "[maven-release-plugin] prepare for next development iteration"

This reverts commit e480bcfbd269ae1d7a6a92cfb50466cf192fe1fb.
Revert "[maven-release-plugin] prepare release v1.0.0-rc6"

This reverts commit 54133abdce0246f6643a1112a5204afb2c4caa82.
[maven-release-plugin] prepare release v1.0.0-rc7
[maven-release-plugin] prepare for next development iteration
HOTFIX: Don't build Javadoc in Maven when creating releases.

Because we've added java package descriptions in some packages that don't
have any Java files, running the Javadoc target hits this issue:

http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=4492654

To fix this I've simply removed the javadoc target when publishing
releases.