A cold compress can lessen pain and swelling in your mouth. Use a towel-wrapped ice pack for 20 minutes at a time. This helps numb the area and reduces swelling.