Only regenerate tree for involved child when removeing panel