I believe that --jar is required, but can be "null" (e.g. when using spark-shell or pyspark).