cleaned and updated list of links to scrape