If Visibility is set to Collapsed, we need to clear desired size before aborting measure.