override requeuing of harvested urls