Revert removal of duplicates as general rule