implemented part of the DuplicateFilter