implementation of scraper specific criteria for deduplication on the pid