DOI: 10.3886/icpsr35510.v1
title: Head Start CARES Demonstration: National Evaluation of Three Approaches to Improving Preschoolers' Social and Emotional Competence, 2009-2015
title: Version 1

description: Low-income preschool children experience greater risks to their social and emotional development than their more affluent peers. These gaps are observed before children begin their formal schooling, and they remain or increase during the elementary school years. Since social and emotional risks may compromise children's future mental health and peer relationships, addressing them is important in its own right. In addition, social-emotional competence may aid learning: children who have difficulty regulating their emotions and behaviors have been found to receive less instruction, to be less engaged in and less positive about their role as learners, and to have fewer opportunities for learning from peers. The Head Start CARES (Classroom-based Approaches and Resources for Emotion and Social skill promotion) demonstration tests three distinct approaches to enhancing children's social-emotional development on a large scale within the Head Start system - the largest federally funded early-childhood education program in the United States. Conceived and sponsored by the Office of Head Start and the Office of Planning, Research and Evaluation in the Administration for Children and Families within the United States Department of Health and Human Services, the Head Start CARES demonstration was conducted by MDRC, a nonprofit, nonpartisan education and social policy research organization, in collaboration with MEF Associates and several academic partners. The three evidence-based social-emotional interventions selected for the Head Start CARES evaluation included: The Incredible Years Teacher Training Program (IY), Preschool PATHS (PATHS), and a one-year version of Tools of the Mind- Play (Tools). The interventions are referred to as "enhancements" because they enriched and complemented existing practices and curricula used in Head Start classrooms. These enhancements represent three "types" of social-emotional programming. That is, while all three were aimed at children's social-emotional development, they varied in their approach to changing this set of child outcomes by targeting somewhat different teacher practices, because they were built on differing theories about how social and emotional skills develop. <strong>Baseline and Follow-up Class-level Impact Analysis Data Files</strong> Data included in class-level data files were collected from external observers and teachers through two sources: Classroom Observations and Teacher Self-Surveys. Classroom Observations were conducted by observers blind to treatment status who observed the classrooms participating in the study in four different sessions at Spring Baseline and Pre-K Follow-up. This source includes the Classroom Assessment Scoring System (CLASS) scores and the Adapted Teaching Style Rating Scale (Adapted-TSRS) scores. Teacher Self-Surveys were collected from lead teachers at Spring Baseline and Pre-K Follow-up. This data source includes information on classroom composition as well as teacher demographics, teaching experience, level of stress and depression, and professional relationship with peers and supervisors. <strong>Child-level Impact Analysis Data File</strong> Data included in this file were collected at Fall Baseline, Pre-K Follow-up and K Follow-up from teachers, children and their parents through three sources: Teacher Reports on Individual Children, Direct Child Assessments and Parent Surveys.Teacher Reports on Individual Children (Teacher Reports) were collected at Fall Baseline, Pre-K Follow-up and K Follow-up. Lead teachers filled out surveys for each child separately, including questions about the child's social skills and behavior, the child's specific knowledge and skills, and the teacher's relationship with the child. Teacher reports were collected for both 4-year-olds and 3-year-olds at Fall Baseline and Pre-K Follow-up, but were not collected for 3-year-olds at K Follow-up. As a cover page to the Teacher Report, a shortened version of the Teacher Self-Survey was collected at K Follow-up and those data are included in this dataset.Direct Child Assessments were conducted at Fall Baseline and Pre-K Follow-up. The dataset comprises data on a set of tasks measuring different skills for each child separately, including social and emotional skills, self-regulation skills and academic skills. Direct Child Assessments were collected for 4-year- olds only.Parent Surveys were collected at Fall Baseline and K Follow-up. The survey was administered by phone and includes information on family demographics, parent-teacher involvement, parent's perception of school safety, child's social skills and behavior problems, parental level of stress and depression, and household composition and income. Parent Surveys were collected for 4-year-olds only. <strong>Class-level Implementation Analysis Data File</strong> This data file includes data collected from coaches, trainers and teachers on teacher training, classroom-based coaching, and classroom implementation. The data included in this dataset were collected through five separate instruments: (1) Teacher Training Attendance Forms, (2) Coach Weekly Logs, (3) Coach Monthly Fidelity Logs, (4) Trainer Fidelity Logs, and (5) Teacher's View of the Enhancement. Data collected from the first four data sources were collected multiple times during the implementation year while the fifth was collected once at the beginning of the implementation year. The instruments were administered through the Head Start CARES management information system (MIS) with the exception of the Teacher Training Attendance Forms, which were collected on paper. The file also includes some Teacher Self-Survey variables. Data were collected for program group classrooms only. <strong>Coach-level Implementation Analysis Data File</strong> This data file includes data collected from coaches and trainers on classroom-based coaching. The data included in this dataset were collected through five separate instruments: (1) Teacher Training Attendance Forms, (2) Trainer Supervision Logs, (3) Trainer Logs of Coach Quality, (4) Coach Demographics Survey, and (5) Coach End-of-Year Reflections. The instruments were administered through the Head Start CARES management information system (MIS) with the exception of the Teacher Training Attendance Forms, which were collected on paper. <strong>Audiotape Analysis Data File</strong> The audiotape data file includes data created using qualitative information (audiotape transcripts of coach-teacher meetings) that can be used to conduct analyses on one of the two components of the professional development model for the Head Start CARES demonstration: classroom-based coaching. <strong>Child-level Tracking Data File</strong> The child-level tracking data file includes parent-reported data collected in elementary school for children from the Head Start CARES sample. It includes information from parents about children's location and grade, social skills and problem behaviors at home, and receipt of special services.
description: The Head Start CARES (Classroom-based Approaches and Resources for Emotion and Social skill promotion) demonstration tests three distinct approaches to enhancing children's social-emotional development on a large scale within the Head Start system. The three evidence-based social-emotional interventions selected for the Head Start CARES evaluation included: The Incredible Years Teacher Training Program (IY), Preschool PATHS (PATHS), and a one-year version of Tools of the Mind-Play (Tools).
description: The Head Start demonstration was conducted over the course of one academic year with 17 Head Start grantees selected to reflect the geographic, racial, and ethnic diversity of the national Head Start population. Grantees were distributed fairly equally across four regions of the country, with four grantees in the Northeast, four in the West, three in the South, and six in the Midwest/Plains states. Also, they were distributed across community action agencies, stand-alone non-profit entities, and large local school systems. Four grantees that participated during the 2009-2010 school year were in Cohort One, and 13 grantees that participated during the 2010-2011 school year were in Cohort Two. Grantees varied on a number of characteristics, including organizational setting, geographic location, urban/rural status, size, and racial or ethnic composition. Within each grantee, groups of 4 or 8 similar centers (in terms of their racial/ethnic composition, part-day/full-day programming, and age classroom composition) were randomly assigned to one of the three enhancements or to a control group that conducted business as usual. In some cases, all centers within a grantee were similar enough in their characteristics that all centers within grantees could be randomly assigned in a single block. However, for some larger grantees, there were differences among groups of centers in racial/ethnic composition, part-day/full-day programming, and/or age classroom composition. The centers in these grantees were grouped into smaller 4- or 8-center random assignment blocks so that all the centers in each block were comparable across these characteristics. A total of 104 centers across 22 blocks were randomly assigned to one of these four groups. Eighteen blocks included four centers in the study, and four blocks included eight centers. Up to six classrooms and an average of 12 children per classroom were included in the study. The preschool sample included 307 classrooms and 3,603 children (2,670 four-year-old children and 933 three-year-old children). For the child-level tracking effort, the study attempted to track 3,588 children: all 4-year-olds that were located in kindergarten (2,655) and the 933 3-year-olds in the preschool sample. Of these children, data was collected on 2,875 at least once during the two-year long-term follow-up period (when the children were in grades 1 to 3).
description: Response Rates: Specific response rates for each collection of each instrument can be found in the codebooks for each dataset. In general, base-line and follow-up impact response rates were &gt; 90 percent, coach-level implementation and child-level impact response rates were &gt; 80 percent and class-level implementation response rates were &gt; 60 percent.
description: Presence of Common Scales: Classroom Assessment Scoring System Adapted Teaching Style Rating Scale Woodcock-Johnson III Expressive One-Word Picture Vocabulary Test
description: The preschool sample included 307 classrooms and 3,603 children (2,670 four-year-old children and 933 three-year-old children). The study attempted to follow the 2,670 four-year-old children into kindergarten for further data collection. Of these children, 2,599 were tracked to their kindergarten classrooms. The sample of classrooms participating in the audiotape study was not intended to be a representative sample of classrooms. Classrooms were selected from the full set of Cohort 2 sites that represented all three curriculum enhancements: Incredible Years (IY), Preschool PATHS (PATHS), or Tools of the Mind--Play (Tools-Play). A total of 21 coach-teacher pairs from 11 Head Start grantees participated in the effort. The audiotape data are restricted to classrooms with audiotaped recordings at all three time periods. Of the 21 coach-teacher pairs that participated in the effort, 18 submitted complete recordings, producing a total of 54 recorded coach-teacher meetings.
description: Datasets: DS0: Study-Level Files DS1: Baseline Class-level Impact Analysis File DS2: Follow-up Class-level Impact Analysis File DS3: Child-level Impact Analysis File DS4: Class-level Implementation Analysis File DS5: Coach-level Implementation Analysis File DS6: Audiotape Analysis File DS7: Child-level Tracking Data File
description: Head Start teachers, students, and parents. Smallest Geographic Unit: State
description: computer-assisted telephone interview (CATI); coded on-site observation; face-to-face interview; on-site questionnaire; web-based surveyData used to estimate the impacts of the Head Start CARES enhancements on teachers, classrooms, and children were collected from multiple sources at four different points in time: (1) in the spring before the preschool year in which the enhancements were implemented (Spring Baseline); (2) at the beginning of the implementation year (Fall Baseline); (3) at the end of the implementation year (Pre-K Follow-up); and (4) in the spring of the kindergarten year, one year after the enhancements were implemented (K Follow-up). Data collected from coaches and trainers submitted through the Head Start CARES management information system (MIS) for monitoring implementation were collected either one time or multiple times throughout the Head Start CARES academic year.Four grantees that participated during the 2009-2010 school year were in Cohort One, and 13 grantees that participated during the 2010-2011 school year were in Cohort Two.