The best way to store these muffins is the store the muffins and glaze separately. Put the unglazed muffins in an airtight container at room temperature for 3-4 days, and the glaze in an airtight container in the refrigerator. Storing muffins in the refrigerator can dry them out.