TITLE: 
Evaluation of a Pilot School-Based Physical Activity Clustered Randomised Controlled Trial—Active Schools: Skelmersdale



Schools are key environments in which physical activity (PA) can be promoted. Various strategies and opportunities should be used to engage children in PA within schools. The aim of this study was to evaluate the effectiveness of the multi-component Active Schools: Skelmersdale (AS:Sk) pilot intervention on children’s PA and sedentary time (ST). The AS:Sk intervention was implemented for eight weeks in four schools with three control schools continuing normal practice. It consisted of eight components: active breaks, bounce at the bell, ‘Born To Move’ videos, Daily Mile or 100 Mile Club, playground activity challenge cards, physical education teacher training, newsletters, and activity homework. Child-level measures were collected at baseline and follow-up, including objectively measured PA. After accounting for confounding variables, the intervention had a significant effect on school day ST which was significantly less for the intervention children by 9 min per day compared to the control group. The AS:Sk pilot intervention was effective in reducing school day ST but significant changes in PA were negligible. To increase the efficacy of the current and future school-based interventions, authors should focus on implementation and process evaluations to better understand how schools are implementing intervention components.
BODY.1. INTRODUCTION:
Children and young people engage in low levels of moderate to vigorous physical activity (MVPA) [1]. Worldwide data revealed 80% of 13–15 year olds do not meet the 60 min of MVPA per day guidelines [2]. Participation in physical activity (PA) during childhood years has a favourable relationship with adiposity, cardiometabolic biomarkers such as cholesterol and blood pressure, physical fitness, and bone health [3]. Psychological outcomes such as self-worth and self-esteem are also positively affected by participation in PA [4,5]. MVPA in particular is most important for health as relationships between health outcomes are most consistent and robust for PA of this higher intensity [3]. Moreover, in addition to low levels of activity, children’s sedentary time (ST) increases during the transition from primary/middle to secondary/high school [6]. Engagement in sedentary behaviours is detrimental to many aspects of health such as body composition, cardiorespiratory fitness (CRF), metabolic syndrome, and cardiovascular disease risk factors [7].
Many barriers can prevent children and young people from engaging in regular PA [8]. As a result, it has been suggested that schools are key environments for PA promotion regardless of the individual circumstances of a child [9]. Recent government recommendations state that half (at least 30 min) of the daily recommendation for MVPA should be accrued during school hours [10,11]. Recommendations for sedentary time are less prescriptive and specific, although efforts to reduce sedentary behaviours and minimise extended periods spent sedentary across the whole day and within schools are advocated [11,12,13,14].
Within comprehensive school PA programmes (CSPAP) [15] the use of a variety of strategies and opportunities is advocated to promote PA within schools, for example during the school day, before and after school, within physical education (PE), and with involvement from staff and family/community [15]. Results from a 2015 meta-analysis indicated that as the number of CSPAP components included in an intervention increased, the effect size associated with change in daily PA also increased [16].
A comprehensive intervention perspective with a focus on multiple-level factors exemplifies a socio-ecological approach [17]. Action Schools! BC (AS! BC) is an ongoing example of an intervention underpinned by the socio-ecological model [18], and which resulted in PA increasing through activities implemented across six different school components named ‘action-zones’ [19]. Literature reviews have further supported this approach to intervention design, stating that interventions targeting different levels of the socioecological model and those that are multi-component in nature can have a positive impact on PA levels [20,21,22,23].
That being said, multi-component interventions are not always successful at increasing PA [24,25]. Multi-component interventions are difficult to put into practice and a lack of implementation, with schools not implementing as intended has previously been reported [24]. More recently, a more pragmatic approach to PA promotion has been proposed which includes the expansion, extension, and enhancement of PA opportunities (theory of expanded, extended, and enhanced opportunities (TEO)) [26]. The use of this approach allows researchers to target various levels within an ecological model but additionally and importantly, identify appropriate targets [26].
The Active Schools: Skelmersdale (AS:Sk) pilot multi-component clustered randomised control trial (RCT) was designed to promote PA across the school day through multiple opportunities which could be integrated into every day school life and implemented by school staff. The aim of this study was to evaluate the impact of the AS:SK intervention on children’s MVPA and ST, and health indicators.

BODY.2. MATERIALS AND METHODS:
BODY.2.1. PARTICIPANTS:
This study is the third phase of the AS:Sk project (ClinicalTrials.gov registration: NCT03283904). Seven primary schools within Skelmersdale, a low-income town, within West Lancashire, UK, participated in the project [27]. Using a sample size calculation that accounted for the pre-determined number of schools, 100 participants (50 per group) were required for a clustered RCT design with seven schools. This calculation was based on AS:Sk study 1 findings and assumed 15 participants per cluster, an intracluster correlation of 0.04, an alpha level of 0.05 and power of 90% [28,29]. Following ethical approval from the University Research Ethics Committee (ref #SPA-REC-2016-342), schools received the relevant paperwork to inform each Year 5 child (n = 239, age 9–10 years) about the study. Passive (“opt-out”) parental consent were obtained in six of the schools, one school chose to use active parental consent, and children completed informed assent forms prior to data collection. This process resulted in 232 participating children (97% recruitment rate).

BODY.2.2. STUDY DESIGN:
Following the collection of baseline measurements, schools were randomly assigned to either intervention or control groups by a member of the faculty unconnected to the study. This randomisation was not blinded due to the nature of the intervention. There was a one-week gap between the allocation of groups and the beginning of the intervention period to allow for the teachers to plan and organise intervention components into their future school plans. Control schools were informed via email of their selection and agreed to continue with their usual timetabled amount of playground breaks and PE lessons without any additional time allocated for PA participation. Details of the flow of participants through the study from baseline to follow up are shown in Figure 1.

BODY.2.3. INTERVENTION:
The Consolidated Standards of Reporting Trials (CONSORT) guidelines extension for clustered RCT were followed for reporting the results of the AS:Sk intervention [30]. The intervention duration was eight weeks and it consisted of eight components. These were active breaks (ABs), bounce at the bell, ‘Born To Move’ (BTM) videos, Daily Mile (DM) or 100 Mile Club (MC), playground activity challenge cards, PE teacher training, newsletters, and activity homework. All intervention approaches were designed to have no financial cost to the project or schools to implement. A description of each intervention component with the recommended implementation duration and frequency per school day or week was presented to each participating class teacher who was asked to adhere to this guidance. These details are presented in Table 1. Schools were given the freedom to implement the components during the school day when it best suited their own timetable, whilst adhering to the duration and frequency guidelines. The consultation of relevant school-based intervention literature and findings from phase two of the AS:Sk project which piloted three components (ABs, BTM videos, recess intervention; unpublished data), informed selection of the current components. The components aligned with elements of the socio-ecological model [17], the youth physical activity promotion model (YPAPM) [31], and TEO [26].

BODY.2.4. MEASURES:
The primary outcome for this study was school day MVPA. The secondary outcomes were achieving 30 min MVPA during the school day, school day ST, whole weekday ST and PA levels, CRF, and body size (BMI z-score). Measurement protocols at baseline and follow up were the same at both time points and took place within the school grounds. Baseline measures were taken in September 2017, with follow up measures taken in November and December 2017.
BODY.2.4.1. PHYSICAL ACTIVITY:
Children wore an ActiGraph GT9X triaxial accelerometer (ActiGraph, Pensacola, FL, USA) which were each initialised to record raw accelerations at a frequency of 100 Hz. Children were instructed to wear the accelerometer for seven days at all times (24 h·day−1), except when engaging in water-based activities such as bathing and swimming. Data was downloaded using ActiLife version 6.11.9 (ActiGraph) and saved in raw format as GT3X files. Raw data files were processed in R (http://cran.r-project.org) using GGIR which converted the raw triaxial accelerometer signals into one omnidirectional measure of acceleration termed the Euclidean norm minus one (ENMO; vector magnitude taken from the three axes minus the value of gravity with negative values rounded up to zero) [45,46]. ENMO values were averaged per 1 s epoch over each of the seven monitored days [47]. Accelerometer non-wear was determined using the method of van Hees et al. [45], which has been applied previously in studies involving children [47,48,49]. Published ENMO prediction equations were used to identify cut-points for classifying activity as MVPA (3 metabolic equivalents (METs; child-specific); 201 mg) [50]. As there is no consensus as to the most appropriate ENMO ST cut-points [51], we also applied the Hildebrand et al. [50] regression equations using 1.5 METs, which resulted in values of 50 mg. Minimum wear time to be included in the analysis was set to 10 h for a minimum of three weekdays at both baseline and follow up [52]. The time periods explored in the analyses included the school day (defined by schools as between the time the timetable begins and the time children are dismissed) and also whole week day (defined as 7 am to 10 pm).

BODY.2.4.2. ANTHROPOMETRICS:
Stature was assessed to the nearest 0.1 cm using a portable stadiometer (Leicester Height Measure, Seca, Birmingham, UK). Body mass was assessed to the nearest 0.1 kg (813 scales, Seca). Body weight in kilograms divided by height in meters squared gave the body mass index (BMI) of each participant. BMI z-scores were assigned [53] and age and sex specific BMI cut-points established children as normal weight or overweight/obese (those who were underweight were grouped into the normal weight category) [54]. Waist circumference was measured to the nearest 0.1 cm using an anthropometric tape measure, and the percentage of waist circumference-to-height ratio (%WHtR) was calculated as a measure of central adiposity [55]. Gender-specific equations were used to predict children′s age from peak height velocity (APHV), as a proxy measure of biological maturation [56].

BODY.2.4.3. CARDIORESPIRATORY FITNESS (CRF):
The 20 m multistage shuttle run test was conducted to provide an estimate of CRF [57]. The total number of shuttles completed by each participant was recorded as a proxy measure of CRF. This test has been previously used with children of a similar age to those in the current study [43,58].

BODY.2.4.4. PSYCHOLOGICAL CONSTRUCTS:
A paper questionnaire pack was administered which included eight items measuring PA self-efficacy [59] and 16 items measuring PA enjoyment [60]. All items were scored using a 5-point scale ranging from 1 (“Strongly disagree”) to 5 (“Strongly agree”). These questionnaires have previously demonstrated strong factorial validity [59,60].

BODY.2.4.5. SOCIOECONOMIC STATUS (SES):
Neighbourhood-level socioeconomic status (SES) was calculated using the 2015 Indices of Multiple Deprivation (IMD) [61]. The IMD is a UK government-produced deprivation measure for England comprising income, employment, health, education, housing, environment, and crime. IMD rank scores were generated from parent-reported home post codes using the National Statistics Postcode Directory database. Every neighbourhood in England is ranked from one (most deprived area) to 32,844 (least deprived area).


BODY.2.5. STATISTICAL ANALYSIS:
Descriptive statistics (mean and standard deviations) were calculated for the outcomes of all participants at baseline and follow-up. Multilevel modelling was performed using MLwiN Version 2.36 (Centre for Multilevel Modelling, University of Bristol, UK) [62] to determine the effects of the intervention. Multilevel modelling was appropriate for use in this study given the design of children clustered within the seven participating schools. Therefore, a 2-level data structure was used with children defined as the first level of analysis, and schools as the second level of analysis.
Continuous outcome variables were school day ST, light PA (LPA) and MVPA, whole weekday ST, LPA and MVPA, CRF and BMI z-score. The dichotomous outcome variable studied (thus logistic multilevel analysis) was achieving 30 min MVPA/school day. Regression coefficients for the group variables (‘0’ indicating control schools and ‘1’ indicating intervention schools) reflected between-group differences in the outcome measures (adjusted for baseline values and covariates). Initially, ‘crude’ interaction analyses were conducted with only the grouping variables and the outcome variable at baseline included in the model [63]. Potential confounding covariates were then added to ‘adjusted’ models whilst still controlling for baseline outcome variables. These potential confounding covariates were selected based on previous research which has deemed them to be influential to the outcomes and depending on the outcome, included gender [1,64], SES [65,66], body size [67,68], CRF [69,70], PA self-efficacy [31], PA enjoyment [31], accelerometer wear time, and whole weekday ST and MVPA [68,71,72]. Regression coefficients from the models were assessed for significance using the Wald statistic and the following equation, (regression coefficient/standard error)2. Statistical significance was set at p < 0.05.
The evaluation of potential effect modification was also carried out on several dichotomous covariates (gender, weight status, central obesity risk, and fitness status). These analyses determined whether the intervention effects were different for the subgroups. Interaction terms were added to the models, consisting of a multiplication of the main determinant (intervention) and the potential effect modifier [63]. Due to the reduced power which interaction terms have, statistical significance for this analysis was set at p < 0.1 [63].


BODY.3. RESULTS:
BODY.3.1. PRELIMINARY RESULTS:
Descriptive statistics are displayed in Table 2 for all participants and by gender, for baseline and follow up measures.

BODY.3.2. INTERVENTION EFFECTS:
Table 3 shows the intervention effects on each outcome. In the adjusted models, time spent engaged in ST during the school day was significantly less for the intervention children compared to the control group (−9.0 min; p = 0.01). There were no intervention effects on any of the remaining outcome measures, although the trends for school day PA and CRF were in a favourable direction. The odds of achieving 30 min of MVPA per school day was 2.79 times higher in the intervention group compared to the control group, however this did not reach significance (p = 0.07).

BODY.3.3. SUB-GROUP ANALYSES:
There were no post-intervention interaction effects in any of the dichotomous variables (sex, weight status, central obesity risk, fitness status) on the outcomes of school day ST and PA, whole day ST and PA, BMI z-score, and CRF.


BODY.4. DISCUSSION:
This study aimed to (1) assess the impact of the AS:Sk multi-component intervention on the primary outcome of school day MVPA, and (2) assess the impact of the AS:Sk multi-component intervention on the secondary outcomes of achieving 30 min MVPA/school day, school day ST, whole weekday ST and PA levels, CRF and body size. Overall, after accounting for confounding variables, the intervention had a significant effect on school day ST which was significantly less for the intervention children by 9 min per day compared to the control group. Trends were observed for favourable changes in school day LPA, PA, MVPA, achieving 30 min school day MVPA, and CRF, however these did not reach significance.
The AS:Sk intervention demonstrates school-based PA components which are novel in their ability to target various time points in the school day with no financial costs to the school. The significant effects that the intervention had on ST are consistent with previous research. For example, the Finnish Schools on the Move study, which allowed schools to plan their own interventions with strategies such as longer recess periods, increased use of equipment during the school day, and staff training, reported decreased ST at 1.5 year follow-up in children similar in age to those in AS:Sk [73]. In contrast, the Active Living multi-component school-based intervention, which used techniques to target PA in school, before, and after school with active transport, and also during leisure time observed a general increase in ST at 12 months follow-up (2.2% more daily time spent in sedentary behaviour), which the authors speculated could have been due to the participants increase in age [25]. Given the short follow up period in the current study, it is difficult to establish whether the initial positive impact on ST would be sustained long term, inhibiting the anticipated age-related increase. Project timescale and subsequent funding precluded the utilisation of a longer-term intervention period and follow up evaluations.
A significant intervention effect on school day ST has implications for both public health policy and child health outcomes. Public health guidelines in both the UK and other countries recommend that overall sedentary time should be limited in children and young people [12,13,14]. Moreover, research has explored the relationship between ST and health indicators, subsequently highlighting the detrimental effects that ST can have on child health. For example, time spent being sedentary is positively associated with BMI z-score, and negatively associated with fitness in children and youth (aged 6–17 years) [74].
Results indicated a modest and non-significant increase in school day MVPA of 1.5 min. Sutherland and colleagues also reported modest increases in MVPA after the implementation of their multi-component school-based programme, ‘PA 4 Everyone’ [41]. Differences to control students were significant, with 3.9 more minutes of MVPA per day accumulated by intervention students [41]. Conversely, the ‘Active Living’ multicomponent school-based PA intervention had no significant effect on MVPA per day and saw a general reduction in PA [25].
The addition of even small amounts of MVPA to the school day may be beneficial to physical health, particularly when compared to interventions which see negative outcomes and also when the age-related decline in MVPA is considered [75]. However, the meaningfulness of potential benefits could be questioned. The addition of MVPA does predict positive effects with decreased adiposity, whilst the replacement of MVPA with any other movement behaviour predicts negative effects with higher adiposity and lower CRF [76,77]. However, these results are based on 15 min reallocations of time which is considerably more than the intervention effect on MVPA in the current study. Researchers and practitioners should focus on developing sustainable strategies for increasing MVPA participation during the school day given its significant importance for physical health. Understanding how interventions are implemented within schools from the perspective of teachers and students alike, may help in the development of successful school-based techni78,79]. Despite this, implementation data are rarely reported in the literature and a lack of standardised definitions and measurements of implementation contributes to this [79]. A review into the barriers and facilitators to the implementation of PA policies in schools concluded that the body of literature surrounding this topic area from a theoretical perspective was scarce [80]. Implementation of PA in the classroom setting has received more coverage in the literature recently, including perspectives from teachers which has provided useful and important considerations for future interventions [81,82].
There were no significant intervention effects on whole weekday movement behaviours (including out of school hours). A previous systematic review concluded that school-based interventions had no effect on leisure time PA [83]. Whilst results were not significant, intervention effects on whole weekday PA were in the negative direction. This could suggest that children compensated for the increased PA opportunities they were provided with during the school day by decreasing their leisure time PA. This theory has also been suggested by previous interventions in which increases in school day MVPA did not translate into positive effects across the day [73]. An intervention which increased the number of compulsory PE lessons found that the percentage of time spent in MVPA during school was greater; however, the percentage of time spent in MVPA out of school was lower when both time periods were compared to normal schools [84]. Further PA compensation research has also suggested that for every additional 10 min spent in MVPA, children engaged in 5 min less the following day [85]. That being said, not all interventions report compensation effects, for example a review of school-based interventions found five in total which were effective at increasing overall PA [86]. AS! BC is one of these interventions that was effective at increasing overall PA [87]. Activities implemented across six action zones in this intervention included extracurricular and family and community, these zones in particular may have been the important factor which limited PA compensation outside of the school day [87].
The CSPAP approach to PA promotion comprises of five different components or points of intervention which includes PA before and after school [15]. Whilst attempts were made to target the out of school period with the PA homework component of the AS:Sk intervention it would appear that more substantial efforts are needed, for example with school-based extracurricular PA opportunities, rather than PA that requires children to engage with in the home environment. Many barriers to participation in out of school PA exist, including parental reported barriers such as safety concerns [88]. Screen time has also been reported by parents as a barrier, particularly as it is seen as the ‘norm’ for children to engage and therefore parents struggle to limit it [88,89]. Parents have reported that engagement in family-based PA intervention programmes would be the most effective way to increase their child’s PA [88]. The out of school time period for PA participation requires more attention, even from interventions which are primarily designed as school-based, in which the out of school barriers to PA participation and the desired family-based sessions should be considered.
The AS:Sk intervention had several strengths. Firstly, it was developed through prior formative research and was theoretically underpinned by conceptual behaviour change models [17,26,31]. This approach adheres to MRC guidelines for the development of complex interventions [90]. In addition, school staff were provided with the flexibility to implement the PA components when it best suited their class or school. This approach is most feasible in the “real-world” school setting in which unpredictable changes to timetables can happen, thus programme flexibility has previously been reported by teachers as a facilitator to implementation [19]. There was also no financial cost to the schools or the project. This would suggest that the intervention can be self-sustained by schools alone and, therefore, has potential for long-term implementation, although the teacher burden relating to planning and implementation should not be understated. The use of objectively measured PA to assess the intervention effect is an important strength of the study. Furthermore, the use of raw accelerations avoids the uncertainty of pre-processed data such as counts and the possibility that signal-filtering methods alter study results [91,92]. A limitation of the study is the modest sample size, which may have resulted in a lack of power in the statistical test outcomes, particularly the positive outcomes which did not reach statistical significance. The number of children who met the accelerometer wear-time criteria at both baseline and follow up measures also impacted on the final sample size. A further limitation was the timing of the follow up measures in both control and intervention schools. By necessity, measures were taken at an atypical school period, in the final few weeks before Christmas. It is in this period that school timetables are often disregarded and festive activities sometimes replace usual practice. Thus, the activity of children may not be representative of the rest of the school year. Intervention schools in particular may not have implemented the intervention in these final school weeks as they may have done so earlier in the school term. Furthermore, given that intervention implementation was sustained by school staff only, without any external support, it is likely that there were differences in implementation between participating schools. Gaining an accurate and objective record of implementation frequency across the eight-week period within each participating school may require daily researcher visits during the intervention period, which was not possible due to the time constraints of the research staff. Alternatively, teacher logs could be used, but these may be more subject to bias. Quantitative data to illustrate implementation frequency across the eight-week period was, therefore, not available, and it is acknowledged that differences in implementation frequency between schools likely impacted the results. The lack of a more long-term follow up measurement period was also a limitation. Given that follow up measurements were taken only eight weeks after implementation it is difficult to understand the sustainability of the intervention. The overall short intervention implementation period of eight weeks is also a weakness of the study, as interventions of longer duration have been shown to be more effective [86].

BODY.5. CONCLUSIONS:
The AS:Sk multi-component school-based PA intervention had a significant positive effect on school day ST. There were no significant intervention effects on any of the other outcome measures. The small sample size of the current study was an important limitation within the study and may have contributed to the analyses lacking power. The school day period should continue to be a priority. Its importance for PA participation has previously been highlighted, and this study indicates that positive effects on ST in particular are achievable across the school day. Modifications to out-of-school components would be beneficial to avoid any compensation effects on PA participation. The AS:Sk intervention has potential to be scaled up to a full trial following modifications based on the results of this pilot study. Future research should focus on exploring ways in which MVPA participation can be increased during the school day. This may be with the development of appropriate school-based techniques or, conversely, focusing on how to improve the implementation of established techniques (such as the components of the current intervention) through process evaluation research.

Question: Compared to control group what was the result of Active Schools: Skelmersdale (AS:Sk) pilot intervention on moderate to vigorous physical activity (MVPA)?
Evidence: In the adjusted models, time spent engaged in ST during the school day was significantly less for the intervention children compared to the control group (−9.0 min; p = 0.01).
Answer: no significant difference