it needs the duplicates after all?