spotify/luigi — pull request #290 by nparrish (2014-03-10 15:30:32+00:00)
Title: Create parent directories on HDFS

When HdfsAtomicWritePipe closes the pipe, it renames the temporary file to the final name, and tries to ensure the directory exists. However, it was not creating the parent directories correctly.