spotify/luigi — pull request #522 by Tarrasch (2014-11-05 16:22:41+00:00)
Title: Make streaming map-reduce use atomic move_dir

This is essentially using the code introduced in spotify/luigi#393,
solving the exact same issue described there.

Without this patch, the renaming is of LBYL nature, and you could end up
with moving a directory inside another instead of actually renaming a
directory.