A preterm or premature baby is delivered before 37 weeks of your pregnancy. Extremely preterm infants are born 23 through 28 weeks. Moderately preterm infants are born between 29 and 33 weeks. Late preterm infants are born between 34 and 37 weeks.