fixing so rate is in scraper proper and not load html dom until after deciding to scrape