[SPARK-3696]Do not override the user-difined conf_dir

https://issues.apache.org/jira/browse/SPARK-3696

We see if SPARK_CONF_DIR is already defined before assignment.
I'm not a bash expert, so I'm curious: does the nesting of double quotes work properly here?  Here, we have double quotes inside of the `${}` and surrounding it, too.