Handle prism destroy actions better

Shift responsibility of removing child objects to the model