unique the list of urls before resaving