Kidney stones can cause severe pain that can come in waves in your back or abdomen. Other symptoms can be similar to a UTI, including an urge to urinate, blood in the urine, painful urination, and fever and chills. If you have these symptoms, see a healthcare provider.