The castle was held in fief by a long series of masters: the Patriarchate of Aquileia, the Counts of Gorizia, the city of Cividale del Friuli, the Venetian Republic, and finally the Habsburgs. It appears to have functioned as a dedicated fortress rather than a residence, and had no permanent civilian population in peacetime, only a large garrison; it also housed a prison. The structure was severely damaged in the earthquakes of 1348 and 1511, but was repaired each time. It was finally abandoned in 1651 by its last owners, the Coronini family, for a new manor in Tolmin itself, though it remained sufficiently intact by 1713 to play a role in the great peasant revolt of that year. The castle is currently in ruins, though parts of it have been restored.