Process updated to work with all scrapers, bug fixes