Hydrogen peroxide can be damaging to your gums, your tongue, and your tooth enamel, leading to painful decay that could be costly to repair. Like many chemicals, hydrogen peroxide is only safe in small doses.