Implemented DocumentPipeline and replaced output files with Content.
Fixed broken unit tests.
Added ReferencePipeline as well as Jetty webserver for testing web
crawls, and misc fixes and tuning from testing.
Crawlers now created automatically when passing config to collector.
More work on web-based unit tests.
Fixed several issues introduced with version 2.0.0 changes.   Now
handling multiple importer responses properly.  Added new unit tests.
More...
Minor metadata fix.
Updated to reflect moving pipeline and content classes to Norconex
Commons Lang.
Fixed BasicFeaturesTest.
Upgraded Norconex Committer to 2.0.0 and updated the code accordingly.
Fixed broken unit test.
Redid event model and now throwing more events.
Fixed ClassCastException.
Fixes, code cleanup, documentation.
Now can overwrite default http method creation in
DefaultDocumentFetcher.
Added checks for ignored sitemap/rebots.txt and prevent loading default
if ignored.
Refactored to accomodate major CachedInputStream changes.  Importer
instance now shared.
Added percentage of completion (Log.INFO level).
Added back support for Derby implementation for storing reference data.
Updated all reference to DocCrawl to CrawlData.
Added MongoDB crawl data store and more unit tests.  Changed more
refrences to docCrawl to crawlData.
Added H2 database support for Crawl data store.