Much less garbage collection now!

We were re-linking the raw data to all of the other keys quite
frequently. I think garbage collection was slow because removing nodes
from within an object is much slower than removing entire objects.