can run tests on real or in memory hdfs