Remove via iterator to avoid conncurent modification