Stomach cramps: Babies using spoiled, expired, or lumpy breast milk can cause stomach cramps, bloating, bloating, upset stomach, and fussiness. Food poisoning: Often spoiled breast milk will be contaminated, causing the infant to be infected with bacteria and have diarrhea and vomiting.