expose forAllPendingDo() as public so it can be used elsewhere
dumpPendingAtClose for AMQPCrawlLogFeed, dumps pending urls with 0 status to the amqp feed, similar to Frontier.dumpPendingAtClose for the crawl log
Merge branch 'aitfive-39' into qa