Over-the-counter pain relievers can help manage pain and reduce fever associated with kidney infections, but they do not cure the infection itself. Antibiotics prescribed by a healthcare professional are necessary to treat the underlying infection.