openplanets/nanite — pull request #16 by willp-bl (2014-02-10 16:36:39+00:00)
Title: Configure libs at runtime / optionally save Tika Parser outputs

* Configure which checks are done at runtime (see FormatProfiler.properties)
* Always run GZChecker before FormatProfiler to ensure WARC files are readable (this check is v quick and stops crashed mid way through a profile run)
* Fix runtime dependency issue related to Tika Parser use (classpath loading problem - fixed in FormatProfiler.java and pom file)
* Tika Parser outputs are saved in sequence files, one per input warc
* Various cleanups