Yes, they can. The expired formula can lead to stomach infection or food poisoning, and your baby can suffer from vomiting or diarrhoea or infection.