Use our path to get the filesystem object so we can store on S3
Not optimal, but lets you pass in an s3 path for the generator for segments directories
Temp dirs go on local hdfs, not the segment fs
Use filesystem for output not the one passed in