pass offset through for dedupe