[SPARK-2098] All Spark processes should support spark-defaults.conf, config file

This is another implementation about #1256
cc @andrewor14 @vanzin
Isn't that what we want? If the user sets `SPARK_CONF_DIR` then we should respect it.