whoops, always run scrapers in whitelist
factor out all the code for deciding when to run a scraper