handle the initial setup needed for processing add scraper requests