If you have a dessert cup that’s meant to last, you can easily clean it by putting it in the dishwasher along with other glass cups. For more delicate cups, you may want to clean by hand with a dishwashing cloth and a little dish soap. Rinse very thoroughly afterward, as sometimes bits of soap residue can linger in the bottom of the cup.