Performance: Split the reading of row heights from the setting of
heights so the display is only invalidated once