You can absolutely freeze carrot muffins, but don't add the glaze or toppings if you plan to do so. Bake the muffins and let them cool completely before storing in a resealable freezer bag. They should stay fresh for up to 3 months in the freezer.