With his passing, the palace was sacked during feuds, and the main property passed into the hands of the Della Rovere family. It returned to the Colonna family when Marcantonio I Colonna married Lucrezia Gara Franciotti Della Rovere, the niece of Pope Julius II. The Colonna family's alliance to the Habsburg power likely protected the palace from looting during the Sack of Rome (1527).