Soreness, redness, swelling, or itching at the site of the injection, and headache, nausea, abdominal pain, muscle aches, or dizziness can happen after rabies vaccine. Hives, pain in the joints, or fever sometimes happen after booster doses.