If moving can be a stressful undertaking for an adult, then you know it for sure, it will affect your baby as well. It is the same thing for both adults and children. And that stress can affect your baby or toddler’s sleep.