Evaluating the Effectiveness of Keeping Safe - a School Based Intervention Aimed at Preventing Abuse

Study Overview
=================
Brief Summary
-----------------
This study evaluates the effectiveness of Keeping Safe, a whole school preventative education intervention in improving children's knowledge and understanding to keep safe in situations of abuse. The intervention Comprises three themes (1) Healthy Relationships; (2) My Body; and (3) Being Safe and includes content across the following keeping safe concepts; bullying, neglect, emotional, physical, domestic and sexual abuse, in online and offline contexts. Includes activities for the formal and informal school curricula - 63 lessons will be taught to children by their classroom teacher; 3 per term, 9 per year across 7 years from Primary 1 to primary 7 (age 4-11 years). Each lesson is accompanied by directed homework activities to involve and engage parents and enable them reinforce learning at home. A number of whole school, key stage and year group assemblies have also been prepared. At the beginning of each term school leaders will deliver a prepared assembly to introduce the theme for the term. Following this assembly each teacher will deliver 3 lessons tailored to the age group of their class and parents will assist with home works. The lessons use eBooks, character animations, stories, rhymes, and interactive whiteboard activities to engage children in their learning. The intervention adopts a whole-school approach and seeks to build the capacity and skills of teachers and parents as key partners. Teachers will receive a comprehensive package of training, ongoing support and resource materials to equip them with the skills they need to effectively communicate sensitive keeping safe messages. Parents will also receive a package of resources to help them feel confident about communicating sensitive messages to their children.

Detailed Description
-----------------
Exploratory research, funded by the Department of Education and undertaken by the NSPCC in 2008, investigated the need for preventative education that aimed to equip pupils with the skills to recognise and respond appropriately to bullying, child abuse and domestic abuse in primary schools in Northern Ireland. Subsequently, an intervention was designed based on the findings from stakeholder consultations (NSPCC reports, 2011) and existing research in the field of school based prevention. This study uses a cluster randomised controlled trial (RCT) design to evaluate the effectiveness of Keeping Safe, a whole school preventative education intervention in improving children's knowledge and understanding to keep safe in situations of abuse including sexual and domestic abuse. Randomisation will take place at school level. Schools will be allocated either to the intervention group or a waitlist control group. Following randomisation, intervention schools will receive the package of training and support across a 3 month period. This comprises a blended package of continuing professional development training and support for teachers and school staff to enable them teach sensitive preventative education concepts through the formal statutory Personal Development curriculum, and all other informal opportunities that present in the daily life of the school. Intervention schools will then implement the Keeping Safe intervention in their school for 2 school years, between 2016 and 2018. The Wait List Control group will continue with standard practice, teaching the Personal Development curriculum between 2016 and 2018. Both groups will participate in the evaluation between March 2016 and July 2018 and the wait list control group will receive the programme in Sept 2018. This RCT will collect data at 3 timepoints: Baseline (March/ June 2016), Time One (May -June 2017) and Time Two (May- June 2018). Outcome data on children's knowledge and understanding will be collected at all 3 time points as will data on (1) teacher confidence and teaching practice, (2) parent confidence and practice, (3) school level administrative data (e.g. incidence of disclosure and referral out) and (4) school climate/organizational culture. Primary outcomes (childrens) If exposure to the Keeping Safe programme: Impacts/changes children's self-reported knowledge and understanding of the following keeping safe concepts; bullying, neglect, physical, emotional, domestic and sexual abuse and in what ways? Impacts/changes children's self-reported self-efficacy to keep safe in situations of bullying, neglect, physical, emotional, domestic and sexual abuse and in what ways? If children's self-reported knowledge and understanding in relation to the above keeping safe concepts changes over the 2 year period that the programme is being implemented and in what ways? If changes in children's knowledge and understanding vary for different groups of children, and in what ways? Secondary Outcomes (teachers and parents) If engagement with the Keeping Safe programme: Impacts/changes teachers' self-reported knowledge in teaching keeping safe messages and in what ways? Impacts/changes teachers' self-reported confidence and comfort in their own skills to manage sensitive issues in relation to Keeping Safe in the classroom and in what ways? How school context factors such as size, sector and management type, and professional experience factors (length of teaching service, nature of role in school) impact on teacher knowledge, comfort and confidence in teaching Keeping Safe messages. If the continuing professional development training and resources specifically designed for the Keeping Safe programme impact on teachers' teacher knowledge, comfort and confidence in teaching keeping safe messages. If implementing the Keeping Safe programme leads to change in school ethos/climate, and if this differs across schools and in what ways? If engagement with the Keeping Safe programme (parent resources and directed homework activities): Impacts/changes parents' self-reported knowledge of and confidence to communicate with their child about keeping safe messages and in what ways? Impacts/changes parents' self-reported current and future confidence to communicate with their child about keeping safe messages and in what ways? If reported changes in parents' knowledge and confidence vary for different groups of parents and in what ways? How personal (gender) parenting profile (age of children, no of children, relationship to child) and home context (postcode and household income) factors impact on parents' knowledge and confidence in relation to keeping safe messages. How parents' knowledge and confidence change over the 2 year period that the programme is being implemented and in what ways? Data will be collected from children using a questionnaire designed to assess their knowledge and understanding of a range of keeping safe concepts and their self-reported self-efficacy to keep safe in unsafe situations. The questionnaire is a composite measure comprising existing and adapted standardised measures across a range of keeping safe concepts. The content and administration of the questionnaire (online and paper versions available) have been tailored to ensure age and developmental appropriateness (a number of different versions will be used with varying age groups). All classroom teachers will be invited to complete a self-report questionnaire (online or paper versions available) measuring their confidence, comfort and teaching practices with regards the programme. Fidelity data with regard to completion of continuing professional learning will be collated from the analytics function on the e-learning programme. Self-reported fidelity to programme implementation in the classroom will be collated using a fidelity monitoring form. Information on school context (size, sector, management type) and professional experience (length of teaching service, nature of role in school) will also be collected to identify if these impact on teacher knowledge and confidence in teaching keeping safe messages. All parents will be invited to complete a self-report questionnaire (online and paper) to assess their knowledge and confidence to talk to their children about sensitive keeping safe messages. Information will also be collected on parents' personal profile (gender) parenting profile (age of children, no of children, relationship to child) home context (Postcode and household income) to identify if these make a difference to parent knowledge and confidence in communicating with their child(ren) about keeping safe messages Additional school-level administrative data will be collected on Free School Meals/ newcomer children, level of Social Service engagement with school (referrals out etc) to see if these types of experience impact on teacher knowledge and confidence in teaching keeping safe messages, and to examine any difference between intervention and wait-list control schools.

Official Title
-----------------
A Cluster Randomised Controlled Trial of Keeping Safe: Investigating the Effectiveness of a Whole School Preventative Education Programme in Improving Children's Knowledge and Understanding to Keep Safe in Situations of Abuse

Conditions
-----------------
Child Maltreatment

Intervention / Treatment
-----------------
* Behavioral: Keeping Safe


Participation Criteria
=================
Eligibility Criteria
-----------------
Inclusion Criteria: (1) children 4-11 years attending mainstream sector primary school in Northern Ireland whose school has accepted the invitation to take part in the RCT and whose parents have provided consent for their participation. Exclusion Criteria: children attending special sector primary schools in Northern Ireland. children 4-11 years attending mainstream sector primary school in Northern Ireland whose school has not been invited/ rejected the invitation to take part in the RCT children 4-11 years attending mainstream sector primary school in Northern Ireland whose school has accepted the invitation to take part in the RCT and whose parents have not provided consent for their participation.

Ages Eligible for Study
-----------------
Minimum Age: 4 Years
Maximum Age: 12 Years

Sexes Eligible for Study
-----------------
All

Accepts Healthy Volunteers
-----------------
Accepts Healthy Volunteers

Study Plan
=================
How is the study designed?
-----------------

Design Details

Primary Purpose: Prevention
Allocation: Randomized
Intervention Model: Parallel Assignment
Masking: None (Open Label)


Arms and Interventions

| Participant Group/Arm | Intervention/Treatment |
| --- | --- |
| Experimental: Intervention Group<br>The intervention group will receive the Keeping Safe programme between 2016 and 2018. This comprises a blended package of continuing professional development training and support (plus resource materials) for teachers and school staff to enable them teach sensitive preventative education concepts through the formal statutory Personal Development curriculum, and all other informal opportunities that present in the daily life of the school. Following randomisation, intervention schools will receive the package of training and support across a 3 month period and will then implement/teach in their school across 2 school years. The intervention group will collect outcome data for the evaluation between March 2016 and June 2018. | Behavioral: Keeping Safe<br>* A whole school Preventative Education programme<br>|
| No Intervention: Wait-list Control Group<br>The Wait List Control group will continue with standard practice of teaching the statutory Personal Development curriculum between 2016 and 2018. They will not receive the Keeping Safe intervention until Sept 2018 following completion of the evaluation. The Waitlist control intervention group will collect outcome data for the evaluation between March 2016 and June 2018. | |

What is the study measuring?
-----------------
Primary Outcome Measures

| Outcome Measure | Measure Description | Time Frame |
| --- | --- | --- |
| Children's Knowledge of Abuse Questionnaire (CKAQ) (Tutty, 1995) | a 33-item self-report measure used to assess children's knowledge of sexual abuse. | 3 times across 2 years; time 0 baseline March/June 2016, time 1 May/June 2017, time 2 May/June 2018 | 
| Knowledge/Attitudes to Woman Abuse' sub-scale of the 'Child/Teen Witness to Woman Abuse questionnaire (Sudermann et al., 2000) | a 10-item sub-scale used to assess children's knowledge of Domestic Abuse | 3 times across 2 years; time 0 baseline March/June 2016, time 1 May/June 2017, time 2 May/June 2018 | 
| Self-Efficacy Sub-scale (Dake et al., 2003) | a 5-item sub-scale used to assess children's perceived self-efficacy to keep safe in situations of abuse. An additional 4 items were added to this measure concerning online abuse, cyberbullying, and neglect | 3 times across 2 years; time 0 baseline March/June 2016, time 1 May/June 2017, time 2 May/June 2018 | 
| The What-If Situations Test (WIST) (Saslawsky & Wurtele, 1986) | a 6-item scenario-based measure designed to assess children's (aged 5-12) ability to recognise and respond to hypothetical situations of abuse. An additional 5 scenarios concerning non-contact, online, and peer-to-peer abuse | 3 times across 2 years; time 0 baseline March/June 2016, time 1 May/June 2017, time 2 May/June 2018 | 
| two Global Items from the Olweus (1996) bullying questionnaire | used to assess frequency of bullying perpetration/victimization. | 3 times across 2 years; time 0 baseline March/June 2016, time 1 May/June 2017, time 2 May/June 2018 | 
| Adaptation of the Multidimensional Neglectful Behaviour Scale (Kantor et al., 2004) | This 38-item measure is used as a screening tool for neglect. This measure has been adapted to be used as knowledge measure. 10 items across a range of neglect concepts will be used and presented as true/false questions. | 3 times across 2 years; time 0 baseline March/June 2016, time 1 May/June 2017, time 2 May/June 2018 | 
| Administrative school level data on children's behaviour | to be collated as a proxy measure of skills in recognising, telling and reporting abusive behaviour. This includes child in need/ child at risk disclosures, concerns raised, support received from external agencies. | 3 times across 2 years; time 0 baseline March/June 2016, time 1 May/June 2017, time 2 May/June 2018 | 
| Revised Children's Manifest Anxiety Scale (RCMAS 2) short 10 item (Reynold and Paget (1981) | a 10 item short version of the RCMAS - 'What I Think and Feel' used to assess children's self-reported anxiety | twice across 2 years; time 1 May/June 2017, time 2 May/June 2018 | 

Secondary Outcome Measures

| Outcome Measure | Measure Description | Time Frame |
| --- | --- | --- |
| Survey on Perceived Confidence in, and Attitudes towards approaches to Teaching and Learning about Sensitive Issues in Health & Personal Development (Lynagh et al., 2010) | is 26-item survey designed to assess teachers' confidence in teaching and managing sensitive issues in the Health & Personal Development syllabus. Part 2 of this measure will be used to assess teachers' confidence in managing sensitive issues. It has been adapted to focus on the classroom management issues that pertain to the Keeping Safe intervention | 3 times across 2 years; time 0 baseline March/June 2016, time 1 May/June 2017, time 2 May/June 2018 | 
| Subscale of the Teacher Willingness to Teach Sexual Health Education Questionnaire (Cohen et al., 2012) | includes a teacher comfort subscale comprising 26-items. This subscale has been adapted to include topics specific to the Keeping Safe programme. | 3 times across 2 years; time 0 baseline March/June 2016, time 1 May/June 2017, time 2 May/June 2018 | 
| The School Level Environment Survey (SLEQ) (Rentoul & Fraser, 1983; Aldridge et al., 2006) | a 24 item measure that assesses school culture from the perspective of the teacher. This will be adapted to ensure it is culturally appropriate. | 3 times across 2 years; time 0 baseline March/June 2016, time 1 May/June 2017, time 2 May/June 2018 | 
| Teacher fidelity measure | to completion of the CPD training programme and implementation /teaching of keeping safe programme | 3 times across 2 years; time 0 November/December 2016, time 1 May/June 2017, time 2 May/June 2018 | 
| Adaptation of 2 scales from the Parenting and Child Sexuality Questionnaire (Morawska et al., 2015) | adapted to include topics specific to the Keeping Safe Programme. This measure will be used to assess parent's knowledge and confidence to talk to their children about sensitive keeping safe issues | 3 times across 2 years; time 0 baseline March/June 2016, time 1 May/June 2017, time 2 May/June 2018 | 
| Parents' current and future confidence measure (Walsh et al., 2012). | 2 questions adapted to assess parents' current and future confidence to talk to their children about keeping safe | 3 times across 2 years; time 0 baseline March/June 2016, time 1 May/June 2017, time 2 May/June 2018 | 

 Terms related to the study
=================
Keywords Provided by Centre Hospitalier Valida
-----------------
school based prevention, child sexual and domestic abuse