While it's unlikely to get rid of a pepper allergy altogether, it may be possible to reduce your body's sensitization to it by working with a food allergy specialist (a process called immunotherapy). Otherwise, mild symptom management may be possible using over-the-counter medications that can be used when you eat something that contains black pepper.