The American College of Obstetricians and Gynecologists recommends scheduling your trip in your second trimester, between 14 and 28 weeks into your pregnancy.