redundant spark_log_dir creation missed in merge