A baby's umbilical cord stump dries out and eventually falls off — usually within one to three weeks after birth. In the meantime, treat the area gently: Keep the stump dry. Parents were once instructed to swab the stump with rubbing alcohol after every diaper change.