do not crawl external urls twice
do not crawl external urls twice