You certainly can. Make sure you spray down the mug really well. After it's baked, invert it on to a plate.