Added script to crawl all sites