Typically the glaze on cinnamon rolls is made with powdered sugar and milk and a little butter. You can also make a cream cheese frosting which is a little thicker and has the tang from cream cheese. You can’t go wrong with either.