Babies normally have openings in their tummy wall that usually close before or right after they're born. Hernias in babies and kids usually happen when these openings don't close properly, which allows the intestines or other organs to poke through.