Severity is the main difference between allergies and side effects. A true opioid allergy causes severe symptoms like skin lesions, swollen eyes, low blood pressure and difficulty breathing. Mild itching is a side effect, not a symptom of an opioid allergy.