Assessment of the required performance and the development of corresponding program decision rules for neglected tropical diseases diagnostic tests: Monitoring and evaluation of soil-transmitted helminthiasis control programs as a case study
Authors: Bruno Levecke, Luc E Coffeng, Christopher Hanna, Rachel L Pullan, Katherine M Gass
Journal: PLOS Neglected Tropical Diseases
Accepted: 2021-08-17T00:00:00Z


Recently, the World Health Organization established the Diagnostic Technical Advisory Group to identify and prioritize diagnostic needs for neglected tropical diseases, and to ultimately describe the minimal and ideal characteristics for new diagnostic tests (the so-called target product profiles (TPPs)). We developed two generic frameworks: one to explore and determine the required sensitivity (probability to correctly detect diseased persons) and specificity (probability to correctly detect persons free of disease), and another one to determine the corresponding samples sizes and the decision rules based on a multi-category lot quality assurance sampling (MC-LQAS) approach that accounts for imperfect tests. We applied both frameworks for monitoring and evaluation of soil-transmitted helminthiasis control programs. Our study indicates that specificity rather than sensitivity will become more important when the program approaches the endgame of elimination and that the requirements for both parameters are inversely correlated, resulting in multiple combinations of sensitivity and specificity that allow for reliable decision making. The MC-LQAS framework highlighted that improving diagnostic performance results in a smaller sample size for the same level of program decision making. In other words, the additional costs per diagnostic tests with improved diagnostic performance may be compensated by lower operational costs in the field. Based on our results we proposed the required minimal and ideal diagnostic sensitivity and specificity for diagnostic tests applied in monitoring and evaluating of soil-transmitted helminthiasis control programs.
Author summary: The World Health Organization established an advisory group to identify and prioritize diagnostic needs for neglected tropical diseases, and to ultimately describe the minimal and ideal characteristics for new diagnostic tests. To support this advisory group, we developed two generic frameworks, which we applied to soil-transmitted helminthiases: one to explore and determine the required sensitivity (probability to correctly detect a diseased person) and specificity (probability to correctly detect a person free of disease), and another one to determine the corresponding samples size and decision rules during surveys. We showed that specificity rather than sensitivity will become more important when the program approaches the endgame of elimination and that the requirements for both parameters are inversely correlated, resulting in multiple combinations of sensitivity and specificity that allow for reliable decision making. We also highlighted that improving diagnostic performance results in smaller sample sizes for the same level of program decision making. In other words, the additional costs per diagnostic tests with improved diagnostic performance can be compensated by the lower operational costs in the field. Based on our results we proposed to the advisory group the required performance characteristics of diagnostic tests for soil-transmitted helminthiasis control programs.