mje113/krawl — pull request #3 by jwinter (2013-03-08 20:49:35+00:00)
Title: Recaching changes

Follow the same rules we follow for initial crawling when we recache. Specifically, respect the inclusion/exclusion flags and don't recrawl already crawled links.