Add option to use custom Spark distribution.

Add --spark-archive option which overrides the existing methods of
specifying the version of Spark to install on the cluster.