removed duplicate remover, need to make a faster method