significant updates to the way that the annual data scrape works