# Presentation: 790865

## The ED 524B, Grant Performance Report Grants To Reduce Alcohol Abuse

- Dr. Anne D’Agostino
-  Compass Consulting Group, LLC

## Overview of Session

- Introductions
- The Data Quality Initiative
- The Government Performance Results Act (GPRA)
- GPRA indicators for GRAA
- Reporting GPRA data for GRAA

- August 2007

## The Government Performance Results Act (GPRA)

- A law passed in 1993 that requires federally funded agencies to develop and implement an accountability system based on performance measurement.
- Requires all federally funded programs to:
- Outline long-term and annual performance goals that include outcomes,
- Develop indicators to assess performance goals,
- Collect and analyze data on the indicators, and
- Report progress toward achieving performance goals based on the data collected and analyzed.

- August 2007

## GPRA continued...

- Expected outcomes:
- Increased accountability for the expenditures of public funds.
- Improved congressional decision-making through more objective information on the effectiveness of federal programs.
- Promotion of a new governmental focus on results, service delivery and customer satisfaction.
- 	Above excerpted from: *Demonstrating Results, An Introduction to Government Performance and Results Act, Spring 1999*

- August 2007

## GPRA continued...

- Information on GPRA indicators is collected via the Annual Performance Report (**APR**) completed and returned by you (i.e., program grantees)
- Project impacts, as assessed via individual project evaluations using control/comparison groups, are also collected via the APR
- Together this information may be used by Congress to determine future program funding

- August 2007

## GPRA continued...

- Program offices usually fund multiple grantees. Therefore, GPRA data need to be reported in a systematic and standardized manner to allow the program office to:
- aggregate grantee-level data to the program level for GPRA reporting.
- make judgments about data quality.
- show program progress from year to year.

- August 2007

## GPRA for Grants to Reduce Alcohol Abuse (GRAA)

_**Program Purpose**_: To provide resources for Local Education Agencies (LEA) to develop and implement innovative and effective alcohol abuse prevention programs for secondary school students.
_**Program Goal**_**: **To help reduce alcohol abuse among secondary school students.
- _Objective 1_: Support the implementation of research-based alcohol abuse prevention programs in secondary schools.

- August 2007

## GPRA for GRAA continued...

- The three GPRA measures developed to assess the outcomes for GRAA. They include:
- The percentage of grantees whose target students show a measurable decrease in binge drinking.
- The percentage of grantees that show a measurable increase in the percentage of target students who believe that alcohol abuse is harmful to their health.
- The percentage of grantees that show a measurable increase in the percentage of target students who disapprove of alcohol abuse.

- August 2007

## Reporting on GPRA Indicators

**Report GPRA data as directed in the  524B/APR guidance document.**
- In general, the goal for GPRA reporting is for grantees to provide consistent data by
- using the same instrument and/or survey items throughout the life of a project;
- reporting unduplicated and aggregated counts across all of their model programs, sites, grade levels, etc.; and
- reporting the total number of students surveyed as well as the total number of students who respond.

- August 2007

## Definitions for GPRA Reporting

_*Baseline data:*_ Total of all data collected before implementation or as close as possible to the first day of implementation each year.
_*Year-end data:*_ Total of all data collected at the end of implementation each year.
- The numbers for baseline and year-end should be an unduplicated aggregate, combining data for all of the programs, schools, or grade levels involved in program implementation.

- August 2007

## Definitions for GPRA Reporting continued...

***GPRA 1: ***For grantees in cohorts 2004 and 2005,* *_*binge drinking*_ has been defined as the consumption of five or more drinks in one sitting within either a 2-week or 30-day period of time.
***GPRAs 1 and 2: ***The definition used for measuring _*alcohol abuse*_ should be valid and reliable for measuring the behavior as substantiated by and referenced in the literature.

- August 2007

## Definitions for GPRA Reporting continued...

***GPRA 2: ****Students who believe that alcohol abuse is harmful to their health*
***GPRA 3: ****Students who disapprove of alcohol abuse*
- Research has shown that* *perception of harm to peers can be used as a valid proxy for an adolescent’s perception of harm to self.
- Remember to measure consistently through the life of your project.

- August 2007

## GPRA DATA ON THE 524B

- Enter the _Project Objective_.
- _Performance Measure:_ Enter the text of the GPRA measure for which data is being provided. **Baseline data should be entered in 1.a.;Year-end data should be entered in 1.b. **
- _Measure Type_: Type “GPRA” in this box.

- August 2007

## GPRA DATA ON THE 524B continued...

- _Target:_ This section should be left blank for GPRA measures and completed for _project_ measures only.
- _Actual Performance Data_
***Raw Number***--Enter the number of students served by the grant providing survey responses indicating that they engage in binge drinking (GPRA 1), their belief that alcohol abuse is harmful to their health (GPRA 2), or disapproval of alcohol abuse (GPRA 3).
***Ratio***--Enter the raw number from the previous box as the numerator and the total number of students responding as the denominator. _These numbers should be unduplicated and aggregated. _
***%***--The calculation of percentage is optional.

- August 2007

## GPRA DATA ON THE 524B continued...

- _Explanation of progress:_** ** Include a description of evaluation methods and additional data or qualitative detail, where appropriate, to help interpret findings. This should include the following:
- What instrument and items were used?
- What data was collected? When and from whom?
- If relevant, include the use of comparison/control groups, reporting data separately for different intervention groups.
**What was the response rate (i.e., the number of students completing a survey divided by the total number of students surveyed)?**
- How many responses for the item(s) of interest were missing?

- August 2007

## GPRA DATA ON THE 524B continued...

- How were data analyzed? If relevant, include weighting and numbers for each response category.
- Describe preliminary findings or outcomes that demonstrate progress towards each GPRA or project performance measure.
- Describe how performance data demonstrate that it has met or is making progress towards meeting each project objective.
- If expected data were not attained or progress not made, provide an explanation with steps and schedules for addressing the problem or issue.
- Describe how data were used to make improvements to the original project plan (e.g., project activities and milestones) that are consistent with approved objectives and scope of work.

- August 2007

## EXAMPLE FOR ENTERING GPRA DATA ON THE 524B

_*Sample scenario*__:_
- Springfield School District has an alcohol abuse reduction grant, which targets all 9th-12th graders in the district. During the previous spring semester, the Communities That Care survey had been administered to all 9th-12th graders (n=3,368); of the 2,797 students who returned a completed survey, 826 students responded that they had, at some point in the last two weeks, consumed five or more drinks in a row. In March of the first year of implementation (year 1), the same survey was administered to 3,432 students; of the 2,929 students who returned a completed survey, 754 students responded that they had, at some point in the last two weeks, consumed five or more drinks in a row.

- August 2007

## EXAMPLE FOR ENTERING GPRA DATA ON THE 524B continued...

- _Project Objective:_ Type “Reduce the percentage of target students who engage in binge drinking
- _Performance Measure_: Type “The percentage of target students who consumed more than 5 drinks in a row in the past 2 weeks [or 30 days, etc.]--baseline [or] --year-end”
- _Measure__ __type:_ Type “GPRA”

- Analysis and instructions, for both baseline and year-end data:

- August 2007

## EXAMPLE FOR ENTERING GPRA DATA ON THE 524B continued...

- _Target:_ **Leave this blank for GPRA measures.**
- _Actual performance data:_ For “**raw number**”, type the number of binge drinking students. For “**ratio**”, type the number of binge drinking students over the total number of students completing the survey. If you choose to calculate the “**%**”, enter the percentage of binge drinking students by dividing the numerator by the denominator, multiplying by 100, and entering the result.

- August 2007

## EXAMPLE FOR ENTERING GPRA DATA ON THE 524B continued...

- _ __Explanation of progress:_ See example below.
- Springfield School District has an alcohol abuse reduction grant, which targets all 9th-12th graders in the district. During the previous spring semester, the “Communities That Care” survey was administered to all 9th – 12th graders (n=3,368). The item for binge drinking defined it as “five or more drinks in a row at some point in the last two weeks.” 2,797 students turned in a completed survey for a response rate of 83.05%; 826 responded that they had engaged in binge drinking. In March of the first year of implementation (year 1), the same survey was administered to 3,432 students. 2,929 students responded (85.34%) of which 754 students responded that they had engaged in binge drinking. [_Note_: Also include explanation of the methods used to collect the data and the validity of the data. Describe what efforts are in place to improve data for this measure.]

- August 2007

## Discussion

- Any questions?

- August 2007