You can start giving your baby a sponge bath after their umbilical cord stump falls off and the area is fully healed. After that, you can start giving them a bath in a baby tub or sink a few times a week.