If ice packs and pain-relief medication don't work, topical oral anesthetics, such as Anbesol or Orajel, can provide some relief when rubbed on the more painful areas.