Yes. In order for them to properly set, they need to cool completely. To let them set further, you can chill them in the refrigerator covered for 1-2 hours—or overnight.