revise crawl for ^c, scrape for file-types