In a sponge bath, you don't place your baby in a tub to bathe him/her. You use a wet washcloth to clean your baby while the baby’s lying on a dry towel. You should sponge bath your baby only 2–3 times per week. About five to ten minutes is all that is needed for a sponge bath.