Breast milk can go bad even after you put in your best efforts. Some signs that can indicate spoiled breast milk include a foul smell or a sour taste. If any of these signs appear, it is best to discard the milk as the baby's health is of prime importance.