When a person suffers stinging pain when they kneel, it could be bursitis of the knee, also referred to as Housemaid’s Knee. Other possible conditions that could cause this type of pain are a meniscus tear or injury to nerves.