Yelp/mrjob — pull request #259 by l33twolf (2011-11-10 15:48:16+00:00)
Title: Fix broken stream_output when used with MultipleOutputFormat (oddjob)

In the development branch, stream_output does:

self.cat(self.path_join(self.get_output_dir(), 'part-*'))

as per issue #126

but this breaks MultipleOutputFormat which inserts folders between the output directory and the 'part-*' files. Additionally, MultipleOutputFormat could be used to change the leaf naming scheme and 'part-' might not even be part of the file names.

I propose that since the output directory must be empty before job start that we will just want to cat the entire output directory when streaming output.