Distributed Web Crawling Using Network Coordinates
Consistent hashing and random trees: distributed caching protocols for relieving hot spots on the World Wide Web