Don't recache already crawled paths or paths that are about to be crawled