Earl of Elgin
Its first occupant was James Bruce, 8th Earl of Elgin, who moved into the building in 1863.