# Presentation: 187224

## Data and Evaluation Update

**Nikki D. Bellamy, Ph.D.**
- SAMHSA/CSAP
- February 14, 2006

## Copies of the Presentation

- _For the sake of trees..._
- Requests for an electronic copy of this presentation can be sent via email
- _nikki.bellamy@samhsa.hhs.gov_

**Notes:**
Based on the amount of paper that is generated with data and evaluation – note the last slide.  I will try to do my part when I can to help save a tree.  Therefore, if you want copies of this presentation, email me and I will send to you.  

## New Contractor 

- 	CSAP consolidated its data and evaluation contracts to form a new Data Coordination and Consolidation Center (DC3 or DCCC)
_**Purpose**_: to provide information technology and data management services to CSAP and its grantees

**Notes:**
The DC3 assists states and grantees to implement the Strategic Prevention Framework, will provide data consolidation in order to report on SAMHSA’s National Outcome Measures (NOMS) and other federal reporting mandates.  
See bulleted list for specific responsibilities

Companies associated with the DC3 are the lead contractor – Constella Group, follow by a team of subcontractors including CDM, Human Services Research Institute, and McFarland & Associates.  For more information, please see bottom of page and top of page 2.  

The CSAP Lead for the Data & Evaluation Effort is myself – see my contact information on page 2.  Feel free to call or email me if you have any additional questions after this grantee meeting 

## DC3 Contacts

- Where to send Data Submission?
- 	Laurie Brannon
- 	Constella Group, LLC 10401 Fernwood RoadSuite 200Bethesda, MD 20817-1110ATTN: SAMHSA Methamphetamine/Inhalant Data Submission
- Laurie can be reached by phone 301-571-0240 or
- via email _**lbrannon@constellagroup.com **_

## Question regarding data integrity

Virginia Mulkern, Ph.D.
Phone: (617) 876-0426 
	ext. 2315
Fax: (617) 492-7401
vmulkern@hsri.org 

- Virginia Mulkern, Ph.D.
- Phone: (617) 876-0426
- 	ext. 2315
- Fax: (617) 492-7401
_**vmulkern@hsri.org**_

## Reminder – Data Submissions to DC3

- Baseline (Pre-test) forms by
**October 13, 2006**
- Exit (Post-test) forms by
**January 15, 2007**
- Follow-up forms by
**February 16, 2007**
- We will send out reminders via email

## Process Data

- During stoppage with contractor evaluation activities capacity building and other process measures were not completed
- Starting in May and June 2006 the DC3 will be contacting you to gather final information to complete an overall process measure that captures the three-year grant period

## Data Snapshot for Preliminary Analysis

- Cohort II Methamphetamine/Inhalant Projects
- (Funding 2003-2006)
- 11 of 15 have provided data; 10 included
- Those not providing data- 2 infrastructure, 1 on wrong form, 1produced no outcome data, 1 required detailed editing
- Data received in raw and electronic form
- As of 12/15/05 received 2331 instruments from youth and 57 adult in English

## Key Issues In Data Processing

- Grantees went over 18 months with no data support
- Data were submitted on incorrect forms
- Participant identification numbers wrong or missing
- Grant year not consistently reported correctly

## Initial Data Cleaning Protocol: Key Features

- Recode out of range and missing values as missing
- Skip patterns assessed for consistency
- Clarified demographic values
- Recoded some variables for simpler preliminary analyses

## Data Included in Preliminary Analyses

- Adult
- 57 baseline- intervention
- 21 with pre and post- test data
- 0 comparison group respondents

- Youth
- 961 baseline intervention
- 645 pre- and post-test
- 150 comparison baseline
- 92 pre- and  post-test comparison

## Percent of Youth Who Reported being “Very Truthful”

## Youth Retention Rates by Intervention and Comparison Groups

## Baseline comparison of Intervention and Comparison Groups on Age:Youth

## Percent of Hispanics Among Intervention and Comparison Groups:Youth

## Percent of Youth Intervention and Comparison Group Who Report Smoking

## Percent of Youth Intervention and Comparison Groups Who Report Drinking Alcohol in the Past 30 Days

## Percent of Youth Intervention and Comparison Group Who Report Using Marijuana

## Percent of Youth Intervention and Comparison Group Who Report “Moderate” or “Great “ Risk From Smoking 1+ Packs per day

## Percent of Youth Intervention and Comparison Group Who Report “Moderate” or “Great “ Risk from Smoking Marijuana Once or Twice

## Percent of Youth Intervention and Comparison Group Who Report “Moderate” or “Great “ Risk from Using Marijuana Regularly 

## Percent of Youth Intervention and Comparison Group Who Report “Moderate” or “Great “ Risk from Use of Crystal Meth

## Percent of Adults Who Report Being “Very Truthful”

## Percent of Adult Participants Who Have Completed At Least High School by Completion Status

## Percent of Females Among Adult Participants by Completion Status

## Distribution of Adults by Hispanic Ethnicity

## Drug Use Among Adults At Baseline

## Changes In Adult Drug Use

- Only 2 adult smokers matched.  Neither quit smoking on post test.
- Only 5 matched responses on alcohol consumption.  None quit drinking at post-test
- No matched data on users of marijuana, cocaine, or the amphetamine or methamphetamine

## Final Comments

- The data gathering process and quality of data collected have suffered from disruption in support across sites
- Nonetheless, there are some promising results
- Effect size cannot be determined
- Retention appears to be a general problem
- Data quality issues need to be addressed

## Contacts

- Nikki Bellamy
_**nikki.bellamy@samhsa.hhs.gov**_
- _CSAP Project Officers_
- Wilma Pinnock
- Patricia Sabry

## Questions