Charles Ferdinand was a great patron of art and supporter of the Society of Jesus (he had an enormous silver altar built for the Jesuit Church in Warsaw). In the 1640s, royal architect, Giovanni Battista Gisleni built for him a palace situated on the northern bastion of the Warsaw Royal Castle fortifications. It was later ransacked and destroyed by Swedes and Germans of Brandenburg in 1650s, during the Deluge. He also had a large wooden palace in Wyszków.