Remove any aggravating or underlying cause. A small change, such as wearing a bra with additional support, can be necessary for this. 1. Apply a topical NSAID (nonsteroidal anti-inflammatory drug). 2. Modify birth control tablets. 3. Lower the menopausal hormone therapy dosage. 4. Utilize a prescription drug.