add compression codec trait and snappy compression
fix dependencies
Merge pull request #666 from c0s/master

hbase dependency is missed in hadoop2-yarn profile of examples module
Enhance job ui in spark ui system with adding pool information
Merge remote-tracking branch 'upstream/master'
[BUGFIX] Fix for sbt/sbt script SPARK_HOME setting

In some environments, this command

    export SPARK_HOME=$(cd "$(dirname $0)/.."; pwd)

echoes two paths, one by the "cd ..", and one by the "pwd". Note the resulting
erroneous -jar paths below:

    ctn@ubuntu:~/src/spark$ sbt/sbt
    + EXTRA_ARGS=
    + '[' '' '!=' '' ']'
    +++ dirname sbt/sbt
    ++ cd sbt/..
    ++ pwd
    + export 'SPARK_HOME=/home/ctn/src/spark
    /home/ctn/src/spark'
    + SPARK_HOME='/home/ctn/src/spark
    /home/ctn/src/spark'
    + export SPARK_TESTING=1
    + SPARK_TESTING=1
    + java -Xmx1200m -XX:MaxPermSize=350m -XX:ReservedCodeCacheSize=128m -jar /home/ctn/src/spark /home/ctn/src/spark/sbt/sbt-launch-0.11.3-2.jar
    Error: Invalid or corrupt jarfile /home/ctn/src/spark

Committer: ctn <ctn@adatao.com>

On branch master
Changes to be committed:

- Send output of the "cd .." part to /dev/null
	modified:   sbt/sbt
Allow initial weight vectors in LogisticRegression.
Also move LogisticGradient to the LogisticRegression file and fix the
unit tests log path.
Move ML lib data generator files to util/
Rename loss -> stochasticLoss and add a note to explain why we have
multiple train methods.
Change weights to be Array[Double] in LR model.
Also ensure weights are initialized to a column vector.
Return Array[Double] from SGD instead of DoubleMatrix
Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable (JIRA Ticket SPARK-817)
Merge pull request #712 from stayhf/SPARK-817

Consistently invoke bash with /usr/bin/env bash in scripts to make code ...
fix a bug in build process that pulls in two versionf of ASM.
Merge pull request #715 from viirya/dev1

fix a bug in build process that pulls in two versions of ASM.
Merge pull request #714 from adatao/master

[BUGFIX]  Fix for sbt/sbt script SPARK_HOME setting
Refactor data generators to have a function that can be used in tests.
Rename classes to be called DataGenerator
Merge pull request #710 from shivaram/ml-updates

Updates to LogisticRegression
Do not copy local jars given to SparkContext in yarn mode since the Context is not running on local. This bug causes failure when jars can not be found. Example codes (such as spark.examples.SparkPi) can not work without this fix under yarn mode.