hmmm, good point. 
You could store them as [weak pointers](http://en.cppreference.com/w/cpp/memory/weak_ptr), then the destructor wouldn't destroy anything. I think I'll do that here actually.