Moving to Heritrix 3.3.0
Dropped origin concept. Initial pass at replacing it with 'revistOf'
annotation.
Removed any dead code/options in DeDuplicator
Added WarcIterator for building indexes off of WARC files
Everything is still untested and things are still missing in places.
Dropped all handling of contents size 
- accurate info of the size of the original is not reliably available on
revisits, was never really used
Partial handling of WARC revisit entries
Correctly handles dates in crawl.log now
Removed options that are no longer needed/relevant
Fixed project URL and POM formatting
Ensure that script is executable in *nix environment
A little more lenient on processing HTTP headers. 
No longer store ETags from revisits unless it is a Server-Not-Modified
revisit
Sort the files before iterating over them.
Added revisit profile.
Return string 'unknown' for null mimetypes rather than null value
Cleanup
Made WarcIterator the default. 
Some code cleanup
Updated to Lucene 4.7.1
Include additional Lucene dependencies in dist assembly
Only index revisit items with original URL and Timestamp available.
In the future, enabling lookup via Wayback would be useful.
Update readme to refer to maven site on github.io
Use aggresive canonicalizer in place of custom 'strip url' method.
Removed the 'skip duplicates' option.
Turned the CrawlDataIterator abstract into an interface
Return string list rather than generics for cl args
Moved code for dealing with config and command line args to a special
Launcher class.
Renamed DigestIndexer to the more accurate IndexBuilder
Renamed DigestIndexer to the more accurate IndexBuilder