If your baby starts a bottle but doesn't finish it within an hour, throw the leftover formula away. Bacteria from your baby's mouth can seep into the bottle, contaminate the formula, and make your baby sick if they drink it later.