changes to scripts to crawl data