remove duplication checks