added marks for removing duplicates