refactored scrapers, and consumer/producer threads