remove duplicates cleaning as wget's no-clobber is used