We should also use bin/spark-submit instead of bin/pyspark here.