tweaks to hdfs persistence