A fire in 1855 destroyed the Castle's central section, and David Bryce was commissioned to design a replacement. In 1925 the Macdonald family moved to a smaller house, leaving the castle to the wind and rain. The Castle was put on the market in 1972 and purchased by the Clan Donald Lands Trust.