Use a soft, damp cloth to clean your baby's gums after feeding them. When their baby teeth erupt, you can clean their teeth using a soft-bristled and small-headed toothbrush that you can easily find at a drug store.