apache/spark — pull request #1752 by sarahgerweck (2014-08-03 10:50:27+00:00)
Title: Optionally parallelize the Spark build.

This introduces a new environment variable, `SPARK_BUILD_THREADS`,
that controls the level of Maven parallelization (if set). This uses
Maven 3's syntax for the number of threads: either a simple integer or
something like `1.5C` to indicate 1.5 times the number of cores on the
build server.

On my hardware, (Intel Xeon E5-1620 v2, roughly equivalent to a fast
i7), a setting of `1.5C` speeds up the build by about 15%.

This will trigger some warnings that the Scala plugins are not marked as
threadsafe. Several repeated builds show no differences in the compiled
distribution (save timestamps), but this isn't proof that it can never
fail.