spotify/luigi — pull request #145 by anyman (2013-07-29 19:39:57+00:00)
Title: Changing HadoopJobRunner to use move_dir

HadoopJobRunner used to use move which is not atomic and caused some problems when duplicate jobs were running (another issue). move_dir is atomic since it is doing a mkdir of the path first and should be used instead of move for that reason.