# Presentation: 017382

## Reporting and Monitoring Workgroup

## Workgroup Purpose

-    Create strategies and measures to assess and monitor progress of MCH training grantees in achievement of overall training program goals and individual program objectives

**Notes:**
Rationale: Sustaining and expanding training programs depends upon availability of  process and outcome data that document achievements of the training programs

In short.....We need to document and tell the MCH Program story

## Workgroup Members:

- LEND
- Arnold Birenbaum,** **Albert Einstein College of Medicine
- LEAH
- Mary A. Ott, Indiana University
- Shirley  Robinson Hankins, University of Alabama at Birmingham
- Anne Turner-Henson University of Alabama at Birmingham
- Connie Wiemann, Baylor University
- Nursing
- Irene Jillson, Georgetown University

- Pediatric Pulmonary Centers
- Elisabeth Luder, Mount Sinai School of Medicine
- Pediatric Dentistry
- Cheryl Shaul, University of Washington
- Schools of Public Health
- Marcia Roth, University of North Carolina at Chapel Hill
- John Ehiri, University of Alabama at Birmingham
- Association of University Centers on Disabilities (AUCD)
- Crystal Pariseau

- MCHB Representative: Laura Kavanagh

**Notes:**
Laura Kavanagh is the MCHB representative. 
Crystal Pariseau from AUCD has also participated in this workgroup

## Workplan Focus

- Development of improved reporting mechanisms to capture information on:
- The extent to which graduates of the Training       Programs work in underrepresented areas
- The diversity of current trainees
- Determining indicators of evidence that MCH training projects have translated research into policy, practice or training

**Notes:**
Workgroup Process--
1) Identify indicators of “under-represented” and “underserved”
2) Develop 2 tools to collect relevant information
3) Pretest tools
4) Revise
5) Obtain feedback from grantees and revise as necessary
6) Submit recommendations to MCHB

Design of Data Collection Tools: Focus on most important data elements
Deliberately limited length to one page
Design to be “good” and “useful”, not “perfect”

## Workgroup Products

- Trainee Diversity Form
- Involvement of Graduates in Work Related to Underserved Groups or Communities Form
- Draft performance measure and data collection form on the degree to which MCHB long‐term training grantees engage in policy development, implementation, and evaluation

**Notes:**
The first priority goal of the Reporting and Monitoring group’s workplan was development of improved reporting mechanisms to capture information on the extent to which graduates of the Training Programs work in underrepresented areas; and the diversity of current trainees. Two reporting forms addressing these issues were developed and circulated among all training programs for input in 2007. A pretest was conducted using the forms and based on the results the draft forms have been finalized and copies are in your meeting packet. Items from the Trainee Diversity Assessment form will be used to inform the revision of current performance measure number 9, “current participants from MCHB training programs who are in underrepresented groups.” The form that collects information on graduate work with underserved populations will be used to create a new performance measure. If you have input on either of these issues we would welcome your participation in the workgroup. If that is not possible you can also email Laura your feedback. 
The 2nd priority goal of the group’s workplan was to "determine indicators of evidence that MCH training projects have translated research into policy, practice or training". The group discussed the role of Training Programs in translating research and what the programs can and cannot do and what can be measured in each of these areas. The group then needed to determine whether to focus on policy, practice, or training first in developing performance measures. This was an important issue because there was a time limitation for submitting new performance measurement information to OMB. The submission will occur this summer and the group wanted to address an area that would show that the Training Programs are having an impact. The area that was chosen was policy development, implementation, and evaluation. 
The group developed the performance measure that includes 9 items which focus on the degree to which MCHB long‐term training grantees engage in evidence-based policy development, implementation, and evaluation. The goal of the measure is to identify how successful training programs have been in integrating research into policy discussions and the development of policy options and in having a training curriculum that successfully prepares trainees to do the same. This document is also in your packet. 
The data from the new performance measures will be used to better tell the story of the MCHB Training Programs within MCHB and the Department of Health and Human Services, to report to Congress on accomplishments of the training program, and will also be available on the publicly accessible Discretionary Grant Information System website. These kinds of measure are essential in helping us demonstrate accountability, create partnerships, and build support for the program. 

## Discussion Group Focus

- The small group discussion presents an opportunity for participants to:
- Comment on the policy form that has been shared today for the first time
- Provide input on future directions for the workgroup

## Future Workgroup Plans

- Refine policy development activities measure and reporting form
- Provide input on potential reporting mechanisms for indicators developed by the other workgroups