Revamp the scraper infrastructure to use regex-based pattern matching on which urls are supported.  Also support expanding from a non-scrapable url to a scrapable url using functions of the url and optional page source.