Breadth-first crawling yields high-quality pages
Mercator: A scalable, extensible Web crawler