stewartmckee/cobweb — pull request #8 by rojotek (2012-07-12 21:56:34+00:00)
Title: More crawl finished reliability work

Stew,

Have updated the code after the merge, and also put in some extra tracking of things. I think we are in a much much better place with respect to the crawl_finished queue now.

Rob