This recipe is meant as a sweet treat and I would not leave out the sugar in the pudding. However, you can substitute with coconut sugar if you do not want to use granulated white sugar.