Refactored MLlib tests to run different Spark builds for the same algorithm
Merge remote-tracking branch 'db/master' into refactoringMerge
"Fixed merge conflicts"
Conflicts:
	lib/sparkperf/main.py
Merge pull request #7 from tdas/master

Updated streaming tests - updateStateByKey, groupByKeyAndWindow, and ReduceByKeyAndWindow
Merge pull request #6 from brkyvz/refactoringMerge

Refactored MLlib tests to run different Spark builds for the same algorithm
Move disk warmup code into Cluster class.
Introduce SparkBuildManager to maintain build cache:

SparkBuildManager maintains a cache of binary Spark distributions,
indexed by their SHAs. This makes it much faster to test against
multiple Spark versions because we don’t have to completely re-build
Spark for each test run.

I removed the SPARK_SKIP_PREP configuration option, since it’s not very
useful anymore: if we’re running multiple tests against the same Spark
version, we’ll just use the cached build.

This commit part of the groundwork for automated testing against
multiple Spark versions.
fixing spacing
Merge pull request #10 from seraphin/master

fixing spacing
Fixed that duplicated arr variable is defined as value in DataGenerator.scala
Merge pull request #12 from jameszhouyi/master

Fixed that duplicated arr variable is defined as value in DataGenerator....
Merge pull request #8 from JoshRosen/spark-build-cache

Build using Maven and cache succesful builds
Several build cleanups / improvements:

- Upgrade all subprojects to use newer SBT launch script from Spark; remove
  sbt JARs, since they will now be automatically downloaded.
- Use newer sbt, sbt-assembly, Scala, and ScalaTest versions.
- Remove unused dependency from streaming tests.
- Switch builds to use .scala build definitions instead of .sbt files; this
  will make it easier to introduce a test support library that can be shared
  across test projects.
- Add MLlib perf tests to Travis tests.
- Run `sbt assembly` in Travis tests.
- Add Travis badge to README.
Merge remote-tracking branch 'databricks/master'