If a visual is detached from the tree, we need to invalidateMeasure for its visual parent.