Upped hadoop version 0.23.4 to 0.23.9
Added cache in mapper to reduce sending so many duplicate key/value
pairs to the reducer.
More counters in the reducer.
Remove prep tools mapper tuple cache. It messed up counts.
Add option to prep tool to allow multiple reducers(for later merging)
Added more logging.
Hadoop 0.23.10.
Small fixes.
Added unmodified BZip2 code from https://code.google.com/p/jbzip2/ in an
attempt to improve docId to Bzip2 block offset encoding.
Changed implementation of BZip2 BlockCompressedDocumentCollection to use
org.itadaki.bzip2 instead of Apache's bzip2 implementation.
Added BZip2BlockOffsetTool for creating/examining .blockOffsets files.
Fixes.