Revert "Changing HadoopJobRunner to use move_dir when moving results to final output since move_dir is atomic"

This creates issues as well since we will have an empty output dir that will trigger other jobs to run.

This reverts commit daa6e6368706759622e60db98c0ec73c7198fc0c.