Sync master-csd with Apache Spark 0.8.0

This brings us up to date with the v0.8.0-incubating tag, from which the 0.8.0 release of Apache Spark was cut.  There is still some work to do to completely integrate this into our stack, but it's a good first pass or baseline to work from.