Milk may or may not aggravate your stomach ulcer symptoms. Avoid drinking milk if it increases discomfort. Consider trying low fat dairy if full fat dairy makes symptoms worse. There are also many plant-based milks available to try if dairy irritates your ulcer.