Assign parent to all children when a node is built, or when laziness ends