DOI: 10.3886/icpsr37488.v1
title: Comprehensive Assessment of School Climate to Improve Safety in Maryland Middle Schools, 2015-2018
title: Version 1

description: The major aims of this project were to: 1) Adapt for middle schools and assess the feasibility and acceptability of the Maryland Safe and Supportive Schools (MDS3) Model; 2) Test the efficacy of MDS3 for improving school safety and climate, problem behaviors, engagement, and achievement using a group of randomized controlled trial design in 20 middle schools; and 3) Measure the programmatic costs and benefits associated with implementation of the MDS3 model. Toward that end, during Spring 2015, the study team adapted and finalized the middle school version of Maryland Safe and Supportive Schools (MDS3) model, ensuring that it was feasible and acceptable to implement in middle schools, thereby addressing aim 1. The study team then began a randomized controlled trial in Summer 2015, whereby they recruited, enrolled, and randomized 40 middle schools to intervention and control conditions. The study team then collected baseline (Spring 2015- Fall 2015) and annual follow-up data in the Spring of the 2015-2016, 2016-2017, and 2017-2018 school years. These data included: student, staff, and parent indicators via the online MDS3 School Climate Survey; implementation of positive behavior supports and multi-tiered interventions; classroom and environment observations using two measures: Assessing School Settings: Interactions of Students and Teachers (ASSIST; Rusby et al., 2001) and School Assessment for Environmental Typology (SAfETy; Bradshaw, Milam, Furr-Holden, and Lindstrom Johnson, 2015); and cost data assessing the cost of program delivery in all 40 schools. Additionally, the team collected implementation data from coaches in the 20 intervention schools, which included information on coaching fidelity and ratings of the school engagement.
description: The purpose of this study was to adapt for middle schools and assess the feasibility and acceptability of the Maryland Safe and Supportive Schools (MDS3) model, test the efficacy of MDS3 for improving school safety and climate, problem behaviors, engagement, and achievement using a group randomized control trial in 40 middle schools, and measure the programmatic costs and benefits associated with implementation of the MDS3 model.
description: This study was conducted using a randomized controlled trial, where 40 schools were randomized to either intervention or a comparison condition. Both survey and observational data were collected from students, staff, and parents in each condition.
description: Variables in this study can be split up into four categories: observational, survey, and intervention report data. The observational data is comprised of the ratings obtained by observers hired by the research team. Variables in this category of data contain a broad range of observations both inside and outside of the classroom: demographic data, reviews of teacher effectiveness, student engagement, peer to peer relations, and teacher-student communication. Survey data was collected from students, staff, and parents to assess the overall school climate. Variables in these surveys include assessments of school policies and administrators, reviews of teachers and student, and overall school safety. Intervention report data is made up of the reports of those implementing the various interventions in the schools. Variables in this data contain reviews of student-teacher relations, school policies, and the school's receptiveness to the intervention.
description: Response Rates: This study was focused on whether there were school-level impacts on climate and safety, as measured through surveys, observations, and fidelity tools. Thus, the desired response rate was data for all 40 schools on each data source. Below are the response rates for each data type: <strong>School Climate Survey data</strong>: Baseline (2015): We received data from students at all schools (100%), from staff at 39/40 schools (97.5%), and from parents at 32/40 schools (80%); Year 1 (2016): We received data from students in all 40 schools (100%) and are missing staff data from 1 school (39/40 or 97.5%) and data from parents at four schools (36/40; 90%); Year 2 (2017): We are missing data from students and parents at two schools for a total of 38/40 schools (95%), but we have data from staff at all schools (100%); Year 3 (2018): We have student data from 39/40 schools (97.5%), staff data from 38/40 schools (95%), and parent data from 34/40 schools (85%). <strong>Observational data</strong>: Baseline: We collected data at all schools, however at baseline (2015), there was a transmission error for data for the Assessing School Settings: Interactions of Students and Teachers (ASSIST) survey which resulted in: Data for the classroom ASSIST from all schools, but at one school, we have just 8 out of the targeted 18 classrooms; For the non-classroom ASSIST (which were collected concurrently), we lost data from 4 schools (i.e., 36/40 or 90%). SAFeTy and SET/ISSET data were collected in all schools (40/40 or 100%) Years 1-3: Data were collected from all 40 schools for all observational measures <strong>Coach rated data</strong>: We have data from coaches regarding all 20 intervention schools (100%) for coach fidelity (i.e., school visit logs) for all three years and multiple ratings of school engagement per year for all schools (100%).
description: Presence of Common Scales: Assessing School Settings: Interactions of Students and Teachers (ASSIST; Rusby, Taylor, and Milchak, 2001) School-Wide Evaluation Tool (SET; Sugai et al., 2001)
description: 40 large public middle schools in one Mid-Atlantic state across 4 local education agencies/districts were selected. On average, these schools served 785 students, of whom about half were African American (32.68%) or Hispanic (20.41%). In these schools, an average of 42.18% of students qualified for and were receiving free and reduced-price meals. These schools had implemented Positive Behavioral Interventions and Supports (PBIS) for an average of 9.40 years at the start of the project. The average suspensions rate was 11.57% and achievement/proficiency rates were 80.33% for reading and 63.22% for math. For the student surveys regarding school climate, schools were advised to collect data in at least 18 classrooms (i.e., 3 classrooms per grade level; 6th, 7th, and 8th). Principals were asked to have all staff members complete the surveys, and the surveys were shared with all parents in the school community. The research team was responsible for all data observations and fidelity measures collected by the research team and all classroom and non-classroom environmental observations were collected for all schools. The observations in classrooms were to include a total of 18 classrooms as well, beginning with seeing all Language Arts teachers and then the observer selecting additional Math, Science, and Social Studies class periods to observe, until 18 classrooms were seen.
description: Datasets: DS0: Study-Level Files DS1: Classroom Data Fall 2015 DS2: Classroom Data Spring 2016 DS3: Classroom Data Spring 2017 DS4: Classroom Data Spring 2018 DS5: Non-Classroom Data Fall 2015 DS6: Non-Classroom Data Spring 2016 DS7: Non-Classroom Data Spring 2017 DS8: Non-Classroom Data Spring 2018 DS9: Student School Climate Data Spring 2015 DS10: Student School Climate Data Spring 2016 DS11: Student School Climate Data Spring 2017 DS12: Student School Climate Data Spring 2018 DS13: Parent School Climate Data Spring 2015 DS14: Parent School Climate Data Spring 2016 DS15: Parent School Climate Data Spring 2017 DS16: Parent School Climate Data Spring 2018 DS17: Staff School Climate Data Spring 2015 DS18: Staff School Climate Data Spring 2016 DS19: Staff School Climate Data Spring 2017 DS20: Staff School Climate Data Spring 2018 DS21: SAfETy Data Fall 2015 DS22: SAfETy Data Spring 2016 DS23: SAfETy Data Spring 2017 DS24: SAfETy Data Spring 2018 DS25: SET ISSET Cost Data DS26: Coach Engagement Data DS27: Coach School Visit Data DS28: School Archival Data
description: Middle school students at 40 large public middle schools in Maryland, across 4 local education agencies/districts. Smallest Geographic Unit: School district
description: coded on-site observation; on-site questionnaire