Custom 404 cache now pruned after HTTP queue runs

Removed use of Cache::Preference in favor of the more predictable
approach of pruning the cache after the scheduled requests have been
performed to ensure that no race conditions occur.