Modified pyspark script to ignore environment variables YARN_CONF_DIR and HADOOP_CONF_DIR while testing