Table 1. Stakeholder assessment and engagement plan Stakeholder Name Role of Stakeholder Priority Areas for Evaluation Centers for Disease Control and Prevention (CDC) Monitor program deliverables, requirements and performance measures Provide technical assistance & support for evaluation plan implementation; assess program monitoring and evaluation performance objectives; assess, summarize, document and disseminate evaluation results *Georgia Department of Public Health (GDPH) Georgia Breast and Cervical Cancer Program (GBCCP) Ensure program success through monitoring of program goals, objectives, funding, reports and data Guide evaluation design and implementation; use evaluation results to inform program planning and quality improvement *GDPH Health Districts and local health departments Perform screening, follow-up diagnostic evaluation, case management and interventions (EBIs) Collect and provide data; use evaluation results to inform program planning and quality improvement *GDPH, Chronic Disease Prevention Section, Reporting and Evaluation Unit Collect, analyze, report and evaluate program data Develop and implement evaluation plan; provide recommendations from results; assess, summarize, document and disseminate evaluation results GDPH, Related Chronic Disease Programs Collaborate with the GBCCP to streamline chronic disease prevention efforts Use evaluation results to implement and enhance performance of respective program *American Cancer Society (ACS) Patient Navigation Program (PNP) Provide navigation and education, implement EBIs Collect, analyze and report the ACS PNP data; use evaluation results to inform PNP planning and quality improvement *Participating providers e.g., FQHCs Perform screening, follow-up diagnostic evaluation, case management and EBIs Collect and provide data; use evaluation results to inform program planning and quality improvement Women’s Health Medicaid Program Provide treatment fees for the GBCCP eligible women diagnosed with cancer Collect data Georgia Cancer Control Consortium Implement statewide cancer plan Disseminate evaluation results Women receiving the GBCCP services Receive the GBCCP services Provide data *One or more representative(s) from these stakeholders will participate as members of the ESW. based
Table 4. Dissemination plan Audience Format and Channel Responsibility GBCCP staff Monthly in person updates on data collection and preliminary findings Program data manager, Program evaluator In person PowerPoint presentation of evaluation findings, including feedback and action steps Program evaluator Email evaluation report upon completion Program evaluator CDC Program Consultant and evaluation staff Email evaluation report upon completion Program evaluator, Program director GDPH Health Districts and other participating providers In person PowerPoint presentation of evaluation findings Program evaluator PowerPoint presentation of evaluation findings via webinar and teleconference Program evaluator Email evaluation report upon completion Program evaluator Evaluation Stakeholder Work Group PowerPoint presentation of evaluation findings via webinar and teleconference Program evaluator Email evaluation report upon completion Program evaluator GDPH Chronic Disease Prevention Section leadership and relevant program staff Email evaluation report upon completion Program evaluator Program stakeholders and general public Upload evaluation report on GDPH Website Program evaluator 7.3 Documenting and monitoring audience feedback and action steps: The GBCCP evaluator will document, monitor and analyze feedback from various program staff and stakeholders and develop action steps for continuous quality improvement. A centralized Excel spreadsheet entitled “audience feedback and action steps” will be developed and monitored. Feedback from internal program staff, external partners and other stakeholders from various data sources, such as training and meeting evaluation surveys, meeting minutes, requests for technical assistance from program staff, providers and/or partners, conference calls with the CDC program consultant or the CDC evaluator, will be compiled and updated monthly. Audience feedback, action steps planned, and action steps taken will be documented in this spreadsheet. The evaluator will monitor and analyze this “audience feedback and action steps” spreadsheet quarterly. Evaluation timeline Timeline of evaluation activities that will be performed during this project period is outlined in Table 5.
Data sources, data standards and plans for storage, access, archival and preservation are summarized in Table 7. All released data will have accompanying data dictionary and appropriate documentation that describes the data collection method and potential limitations for usage of the data. For public use, de-identified datasets, data dictionary and relevant documentation will be saved in the GDPH file server to provide access to the data. Data that cannot be de-identified will be provided on request under a data-use agreement. Table 7. Data Management Plan Data Sources Standards Storage Access Archival and Preservation Plan NBCCEDP Minimum Data Elements (MDEs), clinical data from providers MDE definition and data quality indicators Stored in the GDPH file server in compliance with HIPAA regulations. The GBCCP database can be accessed by the GBCCP state staff only. Aggregated data reports are shared with the program staff at all levels. Electronic records: stored in the GDPH file server indefinitely Paper records: stored in the state office for 3 years, and stored in the state archive center for 2 years Pre- and post-test survey for Women’s Health Exam (WHE) trainings and WHE refresher trainings, provider assessment survey, health system assessment interview Data dictionary created by the GBCCP evaluator Stored in the GDPH file server in compliance with HIPAA regulations All survey and interview data will have participant names and contact information removed, with a unique identifier allowing linkage if the need arises while maintaining confidentiality. Clinic data collection form from health systems Data dictionary provided by the CDC Stored in the GDPH file server and the Breast and Cervical Baseline and Annual Reporting System in compliance with HIPAA regulations Clinic data can be accessed by the GBCCP state staff and responsible health system staff only. Stored in the GDPH file server indefinitely