Refactor custom url downloaders. This will allow for the per downloader specific enabling/disabling of caching.