HadoopArgs: hadoopVal needs to be a lazy val
This is because it depends on initialization of the member hadoopOpts, which is done
in the call to "parse" which is done after the HadoopArgs trait is initialized
Merge remote-tracking branch 'upstream/master' into misc_changes
add unit test BuildPyramidSpec, share code with IngestSpec
HadoopArgs: minor change, removed println
Build: take Hadoop version from environment
SharedSparkContext in tests should call library version of createSparkContext
Both Ingest and BuildPyramid need the jar built via "package" otherwise,
it throws a NotSerializableException on our writable objects as they go through shuffle.
If our tests depend on jar being built, we might as well just call createSparkContext
remove comments
Refactor BuildPyramid and Ingest and their respective tests
- refactor BuildPyramid and Ingest drivers to take in their SparkContext
as parameter. This makes it easier to test. Now all code that needs
a SparkContext have their tests pass it down instead of creating it
themselves
Build: take Spark version from environment
Merge pull request #806 from ameetkini/bptests

Add test for BuildPyramid, other minor changes