Address Ryan's feedback
Fix bug found by Ben Roling where new partitions are not created during merge in HDFS.