add compression codec trait and snappy compression
fix dependencies
Enhance job ui in spark ui system with adding pool information
Move ML lib data generator files to util/
Refactor data generators to have a function that can be used in tests.
Rename classes to be called DataGenerator
Do not copy local jars given to SparkContext in yarn mode since the Context is not running on local. This bug causes failure when jars can not be found. Example codes (such as spark.examples.SparkPi) can not work without this fix under yarn mode.
A better fix for giving local jars unde Yarn mode.
fix typo.
also exclude asm for hadoop2. hadoop1 looks like no need to do that too.
Merge pull request #717 from viirya/dev1

Do not copy local jars given to SparkContext in yarn mode
Merge pull request #711 from shivaram/ml-generators

Move ML lib data generator files to util/
Regression: default webui-port can't be set via command line "--webui-port" anymore
Creates Executors tab for application with RDD block and memory/disk used, solves SPARK-808
Changed table format for executors
Merge pull request #716 from c0s/webui-port

Regression: default webui-port can't be set via command line "--webui-port" anymore
Building spark assembly for further consumption of the Spark project with a deployed cluster
Add a public method getCachedRdds to SparkContext
Merge branch 'master' of https://github.com/mesos/spark into ui-808
Fixed memory used/remaining/total bug