In 1656, during the war with the Swedes, the castle was partially ruined, when the retreating land army under Stefan Czarniecki's command had captured and demolished the stronghold. The castle was rebuilt between 1762–1766 under the command of Marszałek Franciszek Bieliński. Later, during the Prussian Partition, a Prussian leader had ordered for demolition of the castle's defense walls, reducing its military importance as a stronghold. In the years to follow, no more reconstruction work on the castle had ever been attempted. Today, only the towers, a brick bridge from the eighteenth century, and the north and east wing of the castle remain of the overall stronghold.