Though they are often used interchangeably, there is a difference between icing and Frosting. Icing is made with sugar and water (sometimes milk) and hardens when it dries. Frosting can be made with many ingredients, such as butter, cream cheese, or sour cream.