The risk of the vaccine causing serious harm is very small. Current vaccines used in the United States cause fewer bad reactions than previous rabies vaccines. Typical mild problems include soreness, redness, swelling, or itching at the sit of the shot. Other mild problems can include headache, nausea abdominal pain, muscle aches, and dizziness.