removed index.html from public
scraper files for other sites