added duplicate filter