SPARK-1184: Update the distribution tar.gz to include spark-assembly jar

See JIRA for details.

Author: Mark Grover <mark@apache.org>

Closes #78 from markgrover/SPARK-1184 and squashes the following commits:

12b78e6 [Mark Grover] SPARK-1184: Update the distribution tar.gz to include spark-assembly jar
(cherry picked from commit cda381f88cc03340fdf7b2d681699babbae2a56e)

Conflicts:

	assembly/pom.xml
SPARK-1190: Do not initialize log4j if slf4j log4j backend is not being used

Author: Patrick Wendell <pwendell@gmail.com>

Closes #107 from pwendell/logging and squashes the following commits:

be21c11 [Patrick Wendell] Logging fix
(cherry picked from commit e59a3b6c415b95e8137f5a154716b12653a8aed0)

Signed-off-by: Patrick Wendell <pwendell@gmail.com>
For outputformats that are Configurable, call setConf before sending data to them.

[SPARK-1108] This allows us to use, e.g. HBase's TableOutputFormat with PairRDDFunctions.saveAsNewAPIHadoopFile, which otherwise would throw NullPointerException because the output table name hasn't been configured.

Note this bug also affects branch-0.9

Author: Bryn Keller <bryn.keller@intel.com>

Closes #638 from xoltar/SPARK-1108 and squashes the following commits:

7e94e7d [Bryn Keller] Import, comment, and format cleanup per code review
7cbcaa1 [Bryn Keller] For outputformats that are Configurable, call setConf before sending data to them. This allows us to use, e.g. HBase TableOutputFormat, which otherwise would throw NullPointerException because the output table name hasn't been configured
(cherry picked from commit 4d880304867b55a4f2138617b30600b7fa013b14)

Conflicts:

	core/src/main/scala/org/apache/spark/rdd/PairRDDFunctions.scala
	core/src/test/scala/org/apache/spark/rdd/PairRDDFunctionsSuite.scala
SPARK-1167: Remove metrics-ganglia from default build due to LGPL issues...

This patch removes Ganglia integration from the default build. It
allows users willing to link against LGPL code to use Ganglia
by adding build flags or linking against a new Spark artifact called
spark-ganglia-lgpl.

This brings Spark in line with the Apache policy on LGPL code
enumerated here:

https://www.apache.org/legal/3party.html#options-optional

Author: Patrick Wendell <pwendell@gmail.com>

Closes #108 from pwendell/ganglia and squashes the following commits:

326712a [Patrick Wendell] Responding to review feedback
5f28ee4 [Patrick Wendell] SPARK-1167: Remove metrics-ganglia from default build due to LGPL issues.
(cherry picked from commit 16788a654246067fd966033b5dc9bc0d4c759b70)

Conflicts:

	core/pom.xml
	dev/audit-release/sbt_app_core/src/main/scala/SparkApp.scala
	dev/create-release/create-release.sh
	pom.xml
	project/SparkBuild.scala
Log4j build fix on 0.9 branch

Spark should include log4j by default. Downstream packagers can exclude log4j
if they want to use another logging backend.
Version fix in pom file
SPARK-1162 Added top in python.

Author: Prashant Sharma <prashant.s@imaginea.com>

Closes #93 from ScrapCodes/SPARK-1162/pyspark-top-takeOrdered and squashes the following commits:

ece1fa4 [Prashant Sharma] Added top in python.

(cherry picked from commit b8afe3052086547879ebf28d6e36207e0d370710)
Signed-off-by: Matei Zaharia <matei@databricks.com>
Fix example bug: compile error

Author: jianghan <jianghan@xiaomi.com>

Closes #132 from pooorman/master and squashes the following commits:

54afbe0 [jianghan] Fix example bug: compile error
(cherry picked from commit 31a704004f9b4ad34f92ae5c95ae6e90d0ab62c7)

Signed-off-by: Patrick Wendell <pwendell@gmail.com>
SPARK-1019: pyspark RDD take() throws an NPE

Author: Patrick Wendell <pwendell@gmail.com>

Closes #112 from pwendell/pyspark-take and squashes the following commits:

daae80e [Patrick Wendell] SPARK-1019: pyspark RDD take() throws an NPE
(cherry picked from commit 4ea23db0efff2f39ac5b8f0bd1d9a6ffa3eceb0d)

Signed-off-by: Patrick Wendell <pwendell@gmail.com>
Adding port configuration for HttpFileServer