NICTA/scoobi — Issue #57: Compress intermediate (BridgeStore) data
Author: blever
Created: 2012-03-08 03:16:02+00:00
State: open

If a given MapReduce job output is only intermediate data (i.e. a `BridgeStore`) it should be compressed. This is possible given it is currently persisted as Sequence files.

All other outputs should be stored as specified by its `DataOutput`/`Persister object` (i.e. they could be compressed if the `Persister` specifies so).