The lands on which Carberry Tower stands were first mentioned in the 11th century when King David I of Scotland granted "Caerbairin" (Carberry) to the monks of Dunfermline Abbey. The first landowner or lessee was John de Crebarrie, but it was the Johnstone family who were the first owners of Carberry Tower. The original building was a simple square tower house, built more for strength than ornament. In 1541, Hugh Rigg, the King's Advocate, leased the lands from the abbey. It appeared Hugh Rigg had an agreement with the Abbot of Dunfermline to lease until 1585. Both John Knox and George Buchanan recorded an unflattering story that Hugh Rigg advised Regent Arran to change the position of the Scottish army at the nearby Battle of Pinkie in 1547. Buchanan mentions that Hugh was known for his corpulence rather than military skill and Knox suggests that Hugh advised the manoeuvre to keep the English away from Carberry.