If the glaze contains some sort of milk, I would recommend storing the muffins in the refrigerator to avoid spoilage. A lemon juice-based glaze can stay out at room temperature for a few days without issue.