The castle was cited for the first time in occasion of the Magyar invasions (934). In the 13th century it was a possession of the Counts Bonifacio, which installed a capitano here. The walls still visible today, were built in 1379 by Cansignorio of the Scaliger family. Their rule was followed by those of the Visconti of Milan and the Carraresi from Padua; the latter lost Soave in 1405 to the Republic of Venice. In 1439 Visconti troops under Niccolò Piccinino captured it back, but Venice regained it soon. During the War of the League of Cambrai (1508), the city was fired and 366 Soavesi killed, but again in 1515 it was reacquired by Venice, which later sold the castle to the Gritti noble family.