Larbin is a spider. It writes fetched urls in a file. The sript getDistinctHosts.py helps me to pick up distinct hosts of these urls.