Yes, you can omit the sweetener or use a sugar-free option if preferred. Keep in mind that the sweetness from the milk alternative will also add some sweetness to the drink.