Infection can spread up the urinary tract to the kidneys, or, less commonly, bacteria in the bloodstream can infect the kidneys. Chills, fever, back pain, nausea, and vomiting are all potential side effects. If doctors suspect pyelonephritis, they will perform urine, blood, and imaging tests.