Yes it's possible but the sugar helps to stabilize the foam of the dalgona, without sugar the foam will not hold very long and it will quickly fall down.