If a patient gets burning knee pain when they kneel, there is usually something that is being compressed inside or around the knee joint. It is most likely knee bursitis. Another possible condition is gout. This condition also causes burning pain; however, it is usually not associated with kneeling. Pain that persists after kneeling could be caused by damage to the nerves in the knee, thigh, or lower back.