This brings up Hadoop HDFS properly

Also a bunch of refactoring, some added idempotence