Recaching changes

Follow the same rules we follow for initial crawling when we recache. Specifically, respect the inclusion/exclusion flags and don't recrawl already crawled links.