More visualizer cleanup

A continuation of 72c52560b5fd934e941f8c3993974c5fbe847b17 to fix
visualizer behavior when adding/removing entities with the same id while
events are suspended.