Skip directly to site content Skip directly to page options Skip directly to A-Z link


Centers for Disease Control and Prevention. CDC twenty four seven. Saving Lives, Protecting People
															Search

		Submit


Tuberculosis (TB)


Facebook
        Twitter
        LinkedIn
        Syndicate





Developing Objectives and Evaluation Questions for TB Program Evaluation							Updated September 10, 2020
																	Related Pages
										Return to Main MenuPurpose**The purpose of this tool is to assist State and Local public health programs as they develop objectives and questions to guide evaluation of their tuberculosis (TB) prevention and treatment programs.**
When evaluating TB programs, appropriate objectives and corresponding evaluation questions help to ensure that the evaluation produces useful information for program improvement. One method to ensure that objectives can be used to track progress and meet the expectations of the evaluation is to make the objectives Specific, Measurable, Achievable, Relevant, and Time bound (SMART).
SMART objectives and evaluation questions can be developed during brainstorming sessions and discussions with internal and external stakeholders.
Taking the time to develop an evaluation plan that includes priority objectives and evaluation questions with shorter term timelines that reflect annual report submission deadlines might lead to more feasible evaluation projects.
Below are examples of SMART objectives and associated evaluation questions. Relevant national TB program objectives and National Tuberculosis Indicators Project (NTIP) indicators are listed under each focus area. Although each example includes several evaluation questions, in practice, a smaller number of questions would be chosen for an evaluation plan. These examples are not meant to be copied directly but are intended to give ideas that can be applied to develop objectives and questions specific to each TB program.
TB programs can use the SMART criteria and the CDC Evaluation Question Checklistpdf icon to assess whether objectives and evaluation questions are feasible, relevant, specific, well-planned, and useful.On This Page
			Increase SurveillanceTimely DocumentationeDOT ProgramEvaluate eDOT StrategySubmit Complete ARPE DataImprove Contact Investigation ExaminationsReferences & ToolsExamples by Focus AreaOpen All Close All
Increase Surveillance Data Reporting of Human Immunodeficiency Virus (HIV) Test Results**Focus Area |**Increase Surveillance Data Reporting of Human Immunodeficiency Virus (HIV) Test Results
**Relevant National TB Objective |**Increase the proportion of TB patients with a positive or negative HIV test result that are reported to the TB program to 99% by 2025.
**Relevant NTIP Indicator |** Known HIV Status
**Example TB Program SMART Objectives |**
Determine by December 2021 (time bound) why or why not (measurable and achievable) patients treated for TB in 2021 have or do not have an HIV test result recorded (specific and relevant).
Identify by December 2021 (time bound) patient and provider barriers to HIV testing (specific, measurable, achievable, and relevant).
**Example Evaluation Questions |**
To what extent are patients offered an HIV test, by provider type (e.g. clinics, hospitals, private providers)?
What challenges do providers experience in receiving and reporting HIV test results?
What are patient-related barriers to obtaining HIV tests? (Consider where HIV tests are performed and the costs per HIV test per patient)
What are practice-related barriers to administering HIV tests?
What are the barriers to obtaining and recording HIV test results for surveillance?Increase Timely Documentation of Sputum Culture Conversion Results**Focus Area |** Increase Timely Documentation of Sputum Culture Conversion Results
**Relevant National TB Objective |** For TB patients with positive sputum culture results, increase the proportion of documented conversion to negative results within 60 days of treatment initiation to 83% by 2025.
**Relevant NTIP Indicator |**Sputum Culture Conversion
**Example TB Program SMART Objectives |**
By March 2021 (time bound), identify barriers to timely documentation of sputum culture conversion results by providers (measurable, achievable, specific, and relevant).
By June 2021 (time bound), identify two strategies to improve sputum culture conversion results reporting to the state health department (specific, measurable, achievable, and relevant).
**Example Evaluation Questions |**
When and how are sputum specimen(s) sent to the laboratory for processing?
How frequently are sputum culture results reported to the TB case manager/state TB staff? How many months after starting TB treatment are results reported?
What challenges do TB program staff identify in sputum culture collection, processing, and reporting?
What factors lead to a longer sputum culture conversion time (e.g., clinical characteristics of TB patients, treatment regimen, program/lab operational protocols)?
To what extent did implementing the Sputum Collection and Reporting Training for State Nurses Program improve the documentation of sputum culture conversion (e.g., improved quality of sputum culture collection, clearer protocols, improved efficiency of data reporting)?Implementation of New Electronic Directly Observed Therapy (eDOT) program**Focus Area |**Implementation of new Electronic Directly Observed Therapy (eDOT) program
**Relevant NTIP Indicator |**Sputum Culture Conversion
**Example TB Program SMART Objectives |**
By January 2021 (time bound), identify the benefits and limitations (measurable and achievable) of offering electronic Directly Observed Therapy (specific and relevant).
By March 2021 (time bound), identify challenges and facilitators (measurable and achievable) of offering electronic Directly Observed Therapy (eDOT) (specific and relevant).
By June 2021 (time bound), initiate a strategy to begin implementing eDOT for TB patients beginning treatment in 2021 (specific, measurable, achievable, and relevant).
By August 2021 (time bound), initiate a strategy to identify and enroll TB patients who are most likely to adhere to telehealth to participate in the eDOT program (specific, measurable, achievable, and relevant).
**Example Evaluation Questions |**
On average, how far do staff travel and how much time is spent to conduct field DOT each week (e.g., traveling to observe DOT at a patient’s location in a week)?
What are the health department costs associated with conducting field DOT?
On average, how far do patients travel to come to the TB clinic? How long does it take patients to travel to the TB clinic?
What are the health department rules and regulations for using eDOT?
What equipment would be needed to implement an eDOT program? (e.g., webcams, software)
How would the health department identify eligible patients for an eDOT program?Evaluate Current eDOT Strategy**Focus Area |**Evaluate current eDOT strategy
**Relevant NTIP Indicator |**Treatment Initiation, Treatment Completion
**Example TB Program SMART Objectives |**
By July 2021 (time bound), describe characteristics of current electronic directly observed therapy (eDOT) strategy (specific, measurable, achievable, and relevant).
By August 2021 (time bound), determine the effectiveness of the current eDOT strategy (specific and relevant) to improve on patient outcomes and benefit program capacity (measurable and achievable).
**Example Evaluation Questions |**
What percentage of TB treatment doses are observed by eDOT compared to doses observed by in-person DOT over the last year?
How much time was spent traveling for each in-person field dose (so that time per dose can be calculated)?
What is the cost per observed dose per TB patient using eDOT compared with the cost per observed dose per TB patient using in-person DOT?
How many doses were administered via synchronous (real-time interaction) vs. asynchronous (not real-time interaction) eDOT?
What percentage of patients with TB completed treatment within 12 months while participating in eDOT compared to in-person DOT?
How much, if at all, has eDOT use decreased staff time spent on DOT compared to in-person DOT?
What are the benefits and challenges of using eDOT compared to in-person DOT according to patients and health care providers?Submit Complete ARPE Data to CDC via NTIP**Focus Area |**Submit Complete Aggregated Report for Program Evaluation (ARPE) Data to CDC via the National Tuberculosis Indicators Project (NTIP) system
**Relevant National TB Objective |** Ensure the 100% completeness of core Aggregate Reports for Tuberculosis Program Evaluation (ARPE) data items reported to CDC by 2025.
**Relevant NTIP Indicator |**ARPE
**Example TB Program SMART Objectives |**
By December 2021, identify barriers (measurable and achievable) that cause missing data items in ARPE data submissions to CDC from cohort period 2018-2020 (specific and relevant).
By March 2022, identify a data quality assurance strategy to address missing data item issues for cohort period 2019-2021 (specific, measurable, achievable, and relevant).
By March 2023, assess the effectiveness of newly implemented data quality assurance strategy for 2021-2022 cohort period data (specific, measurable, achievable, and relevant).
**Example Evaluation Questions |**
How well are each of the core ARPE data items that need to be reported to CDC captured in the monitoring system(s)?
What are the challenges and barriers to gathering and reporting each of the core data items?
What strategies can help us improve ARPE data?
Since applying a new strategy to improve data reporting, how much change is there in the timeliness, completeness, and accuracy of data exchange between health care facilities and the state health department?Improve Contact Investigation Examinations**Focus Area |** Improve Contact Investigation Examinations
**Relevant National TB Objective |** For contacts to sputum Acid-Fast Bacillus (AFB) smear-positive TB cases, increase the proportion to 94% for those who are examined for infection and disease by 2025.
**Relevant NTIP Indicator |** Examination
**Example TB Program SMART Objectives |**
By March 2022 (time bound), identify barriers to completing an examination for TB disease and LTBI among contacts in different population groups (specific, measurable, achievable, and relevant).
By September 2022 (time bound), describe success of implementing targeted testing strategies to increase the proportion of contacts to sputum smear-positive TB cases examined (specific, measurable, achievable, and relevant) to inform future program planning.
**Example Evaluation Questions |**
What barriers are expressed by contacts related to completing their test for TB infection and chest X-ray?
To what extent are the proportion of contacts examined different in regard to demographic characteristics, risk type (medical and social), type of test (e.g., TST, IGRA), and examination setting (e.g., congregate settings, health care facilities, public health clinics, private providers, schools, or household)?
How successful were targeted testing strategies in reaching population groups who are at high risk for TB disease and LTBI?References & ToolsNational TB Program Objectives and Performance Targets for 2025
CDC Evaluation Framework
CDC NCHHSTP Types of Evaluationpdf icon
CDC Asthma Evaluation Question Checklistpdf icon
							
					
						Page last reviewed:  September 10, 2020					Content source: 	Division of Tuberculosis Elimination, National Center for HIV, Viral Hepatitis, STD, and TB Prevention, Centers for Disease Control and Prevention homeTuberculosisBasic TB Factsplus iconHow TB SpreadsLatent TB Infection and TB DiseaseSigns & SymptomsTB Risk FactorsExposure to TBTB PreventionVaccinesTB & HIV CoinfectionTB and DiabetesTB TermsPersonal StoriesTesting & Diagnosisplus iconWho Should be TestedTesting for TB InfectionTesting in BCG-Vaccinated PersonsTB Screening and Testing of Health Care PersonnelTesting During PregnancyDiagnosing latent TB infection and TB diseaseTreatmentplus iconDeciding When to Treat Latent TB InfectionTreatment Regimens for Latent TB Infection (LTBI)Treatment for TB DiseaseAdverse EventsTB Treatment of Persons Living with HIVTB Treatment and PregnancyTB Treatment for ChildrenFrequently Asked QuestionsDrug-Resistant TBResearchplus iconTB Epidemiologic Studies Consortiumplus iconResearch ProjectsPublicationsTB Trials Consortiumplus iconStudy DescriptionsBackgroundBehavioral & Social Science ResearchHealth Care Settingsplus iconTB Infection Control in Health Care SettingsResources for TB Screening and Testing of Health Care Personnelplus iconFrequently Asked QuestionsTB in Specific Populationsplus iconHealth DisparitiesAsian PersonsBlack or African American PersonsHispanic or Latino PersonsChildrenPregnancyCorrectional FacilitiesPeople Experiencing HomelessnessInternational TravelersLaboratory Informationplus iconDrug Susceptibility TestingFalse-Positive Investigation ToolkitInterim Laboratory Biosafety Guidance for XDR  tuberculosis strainsModel Performance Evaluation Program (MPEP)Rapid Molecular Testing to Detect Drug-Resistant TB in the USplus iconExecutive SummaryIntroductionBackground on Tests for Molecular Detection of DRGeneral Considerations and Principles for a Molecular DR Testing ServicePossible Scenarios and Scope of Testing for a Molecular DR Testing ServiceResearch NeedsGeneral Recommendations of the Expert PanelCommunication Plan for the ReportRecommendationsReferencesPanel Members and CDC ParticipantsAppendix 1Appendix 2Appendix 3The Uses of Nucleic Acid Amplification Tests for the Diagnosis of TBplus iconGeneral ConsiderationsGeneral Recommendations of the Expert PanelRecommendations to ACET, CDC, DTBEData & Statisticsplus iconTB Incidence in the United StatesReported TB in the US, 2022 Surveillance Reportplus iconNational DataReporting Area DataRisk FactorsDemographicsTB Treatment and Case OutcomesDrug-Resistant TBMolecular SurveillanceTuberculosis in the United States, 2022 (Slide Set)Archived Surveillance Reports and Slide Sets2021 State and City ReportArchived State and City ReportsProfessional Resources & Toolsplus iconTools for Healthcare ProvidersResources for TB Programsplus iconStrengthening Civil Surgeons’ Capacity to Improve LTBI Surveillance and Outcomes Among Status AdjustersNotice of Funding Opportunity (NOFO)Program EvaluationTB Centers of ExcellenceTB Elimination AllianceTB Genotypingplus iconConventional TB GenotypingWhole Genome SequencingTB GIMSAnalytic ToolsLatent Tuberculosis Infection ResourcesPublications & Productsplus iconPatient and Public MaterialsFact SheetsGuidelinesplus iconControl & EliminationDrug-Resistant TBInfection Control & PreventionLaboratory & GenotypingTB & HIVTB in Specific PopulationsTesting & DiagnosisTreatmentVaccines & ImmunizationsArchived TB GuidelinesGuides & Toolkitsplus iconAggregate ReportsCDC TB Surveillance TrainingCore CurriculumEffective TB Interviewing for Contact InvestigationEthnographic GuidesFalse-Positive Investigation ToolkitForging Partnerships to Eliminate TuberculosisGuide to Application of GenotypingLTBI: A Guide for Primary Health Care ProvidersMantoux Tuberculin Skin Testing ProductsReport of Verified Case of Tuberculosis (RVCT)Self-Study ModulesTB Contact Investigation Interviewing Skills CourseTB eDOT ToolkitUnderstanding the TB Cohort Review ProcessNewslettersplus iconTB Notes, No. 4, 2023TB Notes, No. 3, 2023TB Notes. No. 2, 2023TB Notes. No. 1, 2023TB Notes, No. 4, 2022TB Notes, No. 3, 2022TB Notes, No. 2, 2022TB Notes, No. 1, 2022TB Notes, No. 4, 2021TB Notes, No. 3, 2021TB Notes, No. 2, 2021TB Notes, No. 1, 2021Pamphlets, Brochures, Bookletsplus iconQuestions and AnswersPatient Education SeriesTuberculosis - Get the FactsTuberculosis - The Connection between TB and HIV12-Dose Regimen for Latent TB Infection-Patient Education BrochurePostersplus iconMantoux Tuberculin Skin Test Wall ChartWorld TB DayThink TBStop TBTake on TBReports & Articlesplus iconDTBE Authored Journal ArticlesTuberculosis Laboratory Aggregate ReportsSlide Setsplus iconIntroduction to TuberculosisEpidemiology of Tuberculosis Among Non-U.S.​–Born Persons in the United States, 1993–2016Self-Study Modules on Tuberculosis, 1-5 Slide SetsThe Tuberculosis (TB) in Correctional Settingsplus iconFacilitator GuideIntroduction to TB GenotypingEpidemiology of Tuberculosis in Correctional Facilities, United States, 1993-2017Prevention and Control of Tuberculosis in Correctional and Detention FacilitiesGuidelines for Preventing the Transmission of M. TB in Health care SettingsInvestigation of Contacts of Persons with Infectious TBEpidemiology of Pediatric Tuberculosis in the United StatesTargeted Tuberculosis Testing and Treatment of Latent Tuberculosis InfectionElectronic Tools & ResourcesWeb-Based Courses & Webinarsplus iconTB 101 for Health Care WorkersContent SyndicationInfographicsplus iconSocial Media GraphicsCustomizable Take on TB Infographic with InstructionsEventsWorld TB Dayplus iconU.S. TB ChampionsHistoryFeaturesplus iconTB Risk FactorsTreating Latent TB Infection with Short-Course RegimensWorld Tuberculosis (TB) Day 2021World Tuberculosis (TB) Day 2020Linksplus iconState TB Control OfficesAbout Usplus iconMission Statement and Activitiesplus iconDTBE Strategic PlanNational TB Program ObjectivesOrganization ChartAdvisory Groupsplus iconFederal TB Task Force


About CDC
					Contact Us
					800-232-4636
 Facebook Twitter Instagram LinkedIn Youtube Pinterest Snapchat
 CONTACT CDC
				Contact Us
							Call 800-232-4636
							Email Us
			ABOUT CDC
				About CDC
							Jobs
							Funding
			POLICIES
				Accessibility
							External Links
							Privacy
							Policies
							No Fear Act
							FOIA
							OIG
							Nondiscrimination
							Vulnerability Disclosure Policy
			CONNECT WITH US
				Facebook
								Twitter
								Instagram
								LinkedIn
							Youtube
								Pinterest
								Snapchat
								Email
			LANGUAGES
				Español
							繁體中文
							Tiếng Việt
							한국어
							Tagalog
							Русский
							العربية
							Kreyòl Ayisyen
							Français
							Polski
							Português
							Italiano
							Deutsch
							日本語
							فارسی
							English


U.S. Department of Health & Human Services
			Accessibility
			External Links
			Privacy
			Policies
			No Fear Act
			FOIA
			Nondiscrimination
			OIG
			Vulnerability Disclosure Policy
			USA.gov


Exit Notification / Disclaimer Policy Close
 Links with this icon  indicate that you are leaving the CDC website. The Centers for Disease Control and Prevention (CDC) cannot attest to the accuracy of a non-federal website.
				Linking to a non-federal website does not constitute an endorsement by CDC or any of its employees of the sponsors or the information and products presented on the website.
				You will be subject to the destination website's privacy policy when you follow the link.
				CDC is not responsible for Section 508 compliance (accessibility) on other federal or private website. Website Disclaimers
 Cancel Continue