Your baby might either not accept the milk or spit it out or can vomit the milk after drinking it. However, babies will rarely get diarrhea or fever after drinking spoiled breast milk.