It will create discomfort, agony, and even health concerns if you don't milk a dairy goat. The udders of the goats will uncomfortably swell with milk. Mastitis, an infection of the udder, is also a possibility. You should only stop milking your dairy goat if you are intending to dry her out.