[SPARK-3399] Test for PySpark should ignore HADOOP_CONF_DIR and YARN_CONF_DIR