Around week 5, your baby's brain, spinal cord, and heart begin to develop. Your baby's brain is part of the central nervous system, which also houses the spinal cord.