The castle was built in the 1530s by Antoine de Rochechouart (ca. 1488-1544), a scion of the ancient House of Rochechouart. In addition to being lord of Saint-Amand-en-Puisaye, he was Seneschal of Toulouse and Albigeois and Lieutenant-General of Languedoc, Governor of and of . He was a significant military figure of the time, participated in the defense of Marseilles in 1536, and died of his wounds at the Battle of Ceresole.