If you want, you can use artificial sweeteners or a sugar substitute like Stevia in place of the brown sugar. Or you could simply leave out the brown sugar and have your tea not be sweetened by anything expect the juicy peaches. It will still be delicious and full of flavor.