Decay can occur as soon as your child develops teeth. One of the biggest risks of cavities comes from the usage of baby bottles during sleep or from continuous breast feeding. Milk, formula and other sugary drinks can pool in your child’s mouth, causing the teeth to be exposed to acids that cause decay. If your child needs a bottle to sleep at night, fill it with water.