The heart of an embryo starts beating at about week 5 of pregnancy. It may be possible to detect, at this point, using vaginal ultrasound. Throughout the pregnancy and delivery, healthcare providers monitor the heartbeat of the fetus. Anyone who has concerns about the fetal heartbeat should contact a doctor.