added working support for persistent HDFS; removed the redundant -d option (i.e., -p -d <dir> is now -p <dir>)