No, you don't have to refrigerate cosmic brownies. However, I find that they are easier to cut when they are cold. Plus, the ganache frosting sets up nicely in the refrigerator.