Vomiting or spitting up milk after feeding is common in babies. This is because the splinter muscle present between the esophagus and the stomach is weak and will eventually become strong as the baby matures.