Only set the internal pointers when the node is part of a shadow tree.