The craze to build the most opulent residence possible reached its height in the last half of the 18th century