Keeping the objects on the stack was the problem -- for some big changes we were running out of memory.