While cow’s milk can sometimes cause constipation, it doesn’t happen all the time. If your baby gets constipated every time they drink cow milk, it could be a sign they are allergic.