Rinse your mouth with a mixture of half Milk of Magnesia and half Benadryl liquid allergy medicine. Swish mixture in the mouth for about 1 minute and then spit out. Over the counter numbing mouth rinses or drops can provide short term pain relief.