Yes, cream cheese should really only be out of the refrigerator for about 2 hours. So, you don’t want to keep the frosting out of the refrigerator either. However, if you make the frosting in advance, place it in an airtight container in the refrigerator. Then remove it about 15-30 minutes before you plan to frost your cupcakes so it is soft enough to pipe.