Various owners leased it from royal landlords and the freehold was the subject of frenzied speculation during the 17th century. Which property tycoon inherited the property in the late 19th century