updated scrapers and streamlined pipeline