Yes, it's totally optional to pour the icing. The sweetness in the loaf itself is already balanced, so it’s excellent even without the lemon icing.