Ensure de-duplication occurs on Standard processing pipeline if specified