internetarchive/heritrix3 — pull request #99 by nlevitt (2014-10-03 22:38:39+00:00)
Title: AMQPCrawlLogFeed, DecideRuleSequenceWithAMQPFeed, DecideRuleSequence.logExtraInfo

Most changes here are in heritrix-contrib. Changes to core heritrix are:
* moving some functionality to public api so that new classes in contrib can use them, e.g. BdbFrontier.forAllPendingDo(), AbstractFrontier.needsReenqueuing(), CrawlHost.fixUpName()
* new setting DecideRuleSequence.logExtraInfo, to log even more stuff in an additional json field to the scope log
* a couple of small fixes/improvements, e.g. UriProcessingFormatter.GUESS_AT_LINE_LENGTH