Planning Template: Logic Model Table Inputs Activities Outputs Outcomes Impacts Shorter term Longer term Revised curriculum Experienced trainers Training program expertise Funds Trainees able to take time off work Conduct training for 3,000 health care workers on new HIV/ART guidelines including new first-line regimen 3,000 health care workers trained in new guidelines health care workers have improved knowledge of new ART guidelines, including new first-line regimen health care workers correctly initiate patients on ART more often treated by trained health care workers have increased CD4 counts procedures are established: health care workers use new pocket guides increase in proportion of patients on new first-line regimen increase in patient CD4 counts System-wide procedures are established: health care workers use new pocket guides Population-level increase in proportion of patients on new first-line regimen Population-level increase in patient CD4 counts
Questions and Indicators Template General Evaluation Questions More Specific Evaluation Questions Very Specific Evaluation Questions Anticipated Outcomes Outcome Indicators Did Amanga’s training on new national guidelines result in improvements in health care workers’ knowledge and on‐the‐job performance in correctly prescribing antiretroviral treatment (ART)? Did the trained health care workers (“trainees”) show increases in knowledge of the new guidelines on first-line ART regimens? Did the trainees show improved scores between pre‐ and post‐test knowledge tests on the new guidelines on first‐line ART regimens? Improved scores on questions related to new guidelines on first-line ART regimens. % increase in trainees’ post‐training test scores compared with pre-training scores. Did the trained health care workers show improvements in correctly prescribing ART regimens? Did the trainees show improved on‐the-job performance of prescribing first‐line ART regimens? Increased proportion of health care workers performing correct prescribing of first-line ART regimens. % of trainees who are on an observation checklist as correctly performing ART prescription at least 80% of the time Were there differences in knowledge and performance based on cadre? Did some cadres show greater improvement than others in pre‐ and and in on‐the‐job performance? Differences among cadres in % improvement on pre‐ and post‐test and observation scores. Differences health care worker cadres in % improvements on pre‐ and post‐test and observation scores related to prescribing first‐line ART.
M&E Plan (Section 1 of 2) Outcomes Indicators Methods Tools/Data Sources When/ Frequency Person(s) Responsible Improved scores on questions related to new guidelines on first-line ART regimens % increase between pre- and post-test scores trained health care workers Written test of content knowledge Written test given to trainees Immediately before training and immediately after training Alia Increased % of health care workers performing 80% or more correct on prescribing first-line ART using observation checklist % of health care workers demonstrating 80% or more correct in observation checklist % of newly eligible patients placed on the new regimen Expert clinicians will observe trainees in patient encounters and score them on competencies related to new guidelines Observation checklist Once, before training, and once, within 2 months training Alia, Observer Differences in percentage improvement on pre- and post-test and observation scores among cadres. Differences among health care worker cadres in % improvement on pre- and post-test and observation scores related to prescribing first-line ART Expert clinicians will observe trainees in patient encounters and score them on competencies related to new guidelines Observation checklist Immediately before training and immediately after training Alia, Observer
M&E Plan (Section 2 of 2) Process factors What will be evaluated Methods Tools/Data Sources When/ Frequency Person(s) Responsible Management support for trainees performing new skills Presence, and nature of management support or lack of support for trainees performing new skills Interviews with trainees and facility staff Interview guide Once, during observation activities Alia Heavy workload Patient load at facility Interview or survey facility staff Checklist Once, during observation activities Alia, Observer Staffing at facility Interview or survey facility staff Checklist Once, during observation activities Alia, Observer Availability of supplies and medications Availability of new first-line ART Interview or survey facility staff Checklist Once, during observation activities Alia, Observer Availability of key supplies and infrastructure Interview or survey facility staff Checklist Once, during observation activities Alia, Observer Motivation of trainees to perform new skills on the job Intention to perform new skills Questions on pre- and post-training written test Written test Alia