Initial check-in of a Spark runner and end-to-end test. Only tested insofar as a I see the master and slave nodes come up successfully in the unit test


Former-commit-id: e6275007413da4d794d47120d0263d7144c755b8
Get a SparkPi example to fully run. Main fixes is to include compute-classpath.cmd and winutils.exe in the package, and move them around and get the right environment variables so that Scala and its sub-tasks can find them.


Former-commit-id: 869e39683fb7c8d16d47702aec5c3b594b40451a
Add ability to run Spark against WASB. This involved a few things: 1. Compile Spark with the Hadoop 2.4 profile and use that assembly, 2. Add the hadoop-azure assembly (the one I fixed up for Presto) and the Azure SDK assembly, 3. Fix up compute-classpath.cmd so that Spark-created processes will have WASB in their classpath, 4. Add a core-site.xml and a HADOOP_CONF_DIR environment variable so that we can put WASB-specific properties in there


Former-commit-id: 785c97de63105678e2b2ad9728d43cd567dd5092
Add the Immutable package to the Spark unit test project


Former-commit-id: 1f1168ce0b727229598448d5fe754104038bd0d6
A test service to deploy Spark in Azure


Former-commit-id: f257fb325c701e5bd5805ff2ef1a5fe8bcf34249
Increase the InstallDir size for the Spark test service to accomodate its big jar files


Former-commit-id: 453cf57502d674082769d315f7ddcf382c21b7a0
Add nuspec for the Spark library


Former-commit-id: c20d2e9c8bab55ea3fec4a17a54fc8c895b7f35a
Fix csprof file (missed in latest commit)


Former-commit-id: a52f119c3335c7760bc3aaee87ffa49b23e6d1c3
Split the Spark Jars.zip file to get around github 100 MB file size restriction


Former-commit-id: 0024704e2b1cadc2cb0a5e5f65709f5d9fe0928e