Dedupe pubsubprocessor