ignore url file to start and tolerate failures to keep going