No, you don't need to add the icing, though it does add a nice flavor. You can always use an egg wash instead of the icing.