Revert "Changing HadoopJobRunner to use move_dir

Change created issues as well since we will have an empty output dir that will trigger other jobs to run.

This reverts commit daa6e6368706759622e60db98c0ec73c7198fc0c.