SPARK-1002: Remove Binaries from Spark Source

This adds a few changes on top of the work by @scrapcodes.