You definitely want to wait on the icing until AFTER the rolls are finished baking -- otherwise it will melt through to the bottom and create a sticky mess! That said, we like spreading a bit of frosting on the rolls right when they come out of the oven, and serving the rolls with additional frosting for those who like them extra sweet!