add standalone cdx->cassandra sstable converter for sorted cdx files!
Merge branch 'master' of github.com:internetarchive/ia-hadoop-tools
add cassandra partitioner as pig is having trouble finding the standard one
(only way to get it to work with pig)
cdxtosstable: support for gzip, don't log dupes
Merge branch 'master' of github.com:internetarchive/ia-hadoop-tools
Tools to generate WAT and CDX files for (W)ARCs stored in HDFS
Extract info from warc/metadata records (outlinks/hopinfo)
programdriver-workaround hadoop 1.x & 2.x incompat
better exception handling
generate CDX, WATs, extract WARC metadata fields, repackage records from (W)ARC files
audit log
configurable hadoop job settings
supply commons-collections dependency that had been pulled in circuitously
minor fixes
Merge pull request #3 from internetarchive/hadoop2-prep

don't prepend hard-coded default root to the path...
updated isNull() calls to work with Pig 0.11+