Aristocratic girls who got knocked up by the groom before they can be married off to the prince tend to not have a lot of aristocratic offspring.
There could be a selection process that leads to higher class people getting more elongated until such point as they aren't robust enough to maintain their class privileges.