updates to db, scrape only distinct urls