remove legacy comment.
match uri's in the white/blacklist correctly using urlparse
graveyard is rip.
hub white/blacklist checks for hubs.