NICTA/scoobi — pull request #77 by rathboma (2012-05-04 21:14:35+00:00)
Title: This fix allows working directories to be in s3

There is certainly a better way to do this properly, but this works and is very simple.

To work with s3:
conf.set("scoobi.workingdir", "s3n://bucket/tmp")

that's it. You can now have scoobi output go to s3.

However, some question I have for you all:
- afterwards there's still a bunch of stuff in that directory from the job, not sure why?
- maybe we could namespace the temp directory to be a subdirectory of the output directory? That way a user wouldn't need to set the working directory either.