Rescue only DownloadError
Use a set to track failed downloads