Built as a motte and bailey castle in the 12th century and held by the Comyns, Earl of Buchan. The castle was visited by King Edward I of England in 1296 and also in 1298 after defeating William Wallace at the Battle of Falkirk during the Wars of Scottish Independence. The castle was garrisoned with English troops until being captured by the Scots in 1310. It came into the possession of the Sharps, before being sold to Lord Ogilvy of Deskford in 1722. The castle then passed into the hands of the Russells.