Removing objects always makes the scene dirty

Bug: if you destroy a model, voodoo doesn't always re-render. Same with
removing a model from the scene.