Updates url preparation commands and the urls.
Updates spiders for manual url scraping.