Whenever you have a dessert with dairy in it, you should refrigerate the dessert. Even when there isn't dairy, no-bake desserts with chocolate or peanut butter could melt easily.