If you open the lid and take a sniff, spoiled milk will have a sour or bitter stench. It loses its sweet taste and becomes more acidic. Eventually it'll get chunky or slimy when poured out, at which point you definitely want to dump it down the drain. Drinking spoiled milk can cause vomiting, cramping and diarrhea.