Avoid copying keys around, using pointers instead.
Allowed write back with iterator, to avoid having to find the element again.