All relevant data are within the paper and its Supporting Information files. 

Introduction {#sec005}
============

The importance of fundamental movement skills (FMS) has been well established with regard to children's development \[[@pone.0237919.ref001]\], but research reports a recent decline in the proficiency of children's FMS \[[@pone.0237919.ref002]\].  This is concerning as FMS are--by definition---foundational motor skills that underpin the development of more complex movement patterns required for participation in physical activity (bodily movement produced by skeletal muscles requiring energy expenditure) \[[@pone.0237919.ref003], [@pone.0237919.ref004]\].  The foundational nature of FMS means that they yield a broad-spectrum of associated benefits within childhood development \[[@pone.0237919.ref005]\]---including being positively associated with health, whereby children with well-developed FMS are more likely to participate in physical activity and have a lower body mass index \[[@pone.0237919.ref006]--[@pone.0237919.ref008]\].  Research has also found positive associations between FMS and education outcomes, including language and cognitive development, as well as attention and performance on standardised tests of academic attainment \[[@pone.0237919.ref006], [@pone.0237919.ref009]--[@pone.0237919.ref012]\]. 

The growing lack of proficiency in children's FMS is particularly disappointing as a recent systematic review of school-aged children found that FMS are consistently improved through training and interventions \[[@pone.0237919.ref013]\].  However, physiotherapists and occupational therapists are increasingly overwhelmed by the number of referrals for motor skill assessments \[[@pone.0237919.ref014]\], which has led to parental/guardian dissatisfaction with the services available to support children with motor skill difficulties \[[@pone.0237919.ref015]--[@pone.0237919.ref018]\].  The Chief Medical Officer has recommended the increased participation of schools in helping to reduce the burden on the National Health Service (NHS) in the UK \[[@pone.0237919.ref019]\].  The vision is for schools and healthcare services to collaborate and provide more community-based programmes and initiatives that enhance public health through increasing prevention and early identification of children in need of additional support.  The need for such a collaboration has become yet more urgent after the Covid-19 crisis lockdown where many children have missed essential developmental experiences (e.g. playing outside and interacting with peers). 

It can be seen that there are multiple potential benefits from the use of FMS assessments to screen all pupils within schools to identify those with poor FMS.  It would encourage greater communication between families, schools and healthcare services, which has the potential to expedite access to treatment services and interventions \[[@pone.0237919.ref020]\].  It could help address health and educational inequalities attributed to socioeconomic status (SES) given that research from a large longitudinal cohort study found that mothers from a lower SES are less likely to access primary care facilities \[[@pone.0237919.ref021]\].  It follows that children from a lower SES are less likely be identified as needing extra support with FMS development under current service provision, and therefore less likely to be offered intervention (at least within the UK).  Universal FMS screening in primary schools would provide a more equitable approach to identifying those children in greatest need of support. 

There are currently a large number of assessment tools used to measure FMS both clinically, and for research purposes.  A large proportion of these assessment tools rely on an assessor observing children perform FMS on a battery of standardised tasks.  Standardised observational measures are considered a useful way to assess children's FMS in schools \[[@pone.0237919.ref022]\] as they are reasonably low cost (relative to objective wearable sensors), have minimal data entry and analysis requirements for schools, and are also less susceptible to bias than proxy reports \[[@pone.0237919.ref023]\].  There are a large number of observational assessment methods being marketed to schools \[[@pone.0237919.ref022]\].  The saturation of such measures makes it difficult for teachers, practitioners, and researchers to know which assessment is best suited to identify accurately children who are struggling with FMS development.  This evaluation is particularly challenging as there is a lack of clarity in the literature regarding the validity and reliability of the available observational measures. 

A systematic review was required to document the psychometric properties of the observational assessment tools being promoted as measures of FMS to allow schools and health practitioners to make informed decisions about FMS assessment tools.  This systematic review aims to: (i) establish a comprehensive summary of the observational tools currently used to measure FMS that have been subjected to scientific peer-review; (ii) examine and report the validity and reliability of such assessments. 

Methods {#sec006}
=======

Methods for this systematic review were registered on PROSPERO (CRD42019121029). 

Inclusion criteria and preliminary systematic search {#sec007}
----------------------------------------------------

A preliminary search was conducted to identify assessment tools that were identified in peer-review published research as measures of FMS in school-aged children.  This pre-search was conducted in the seven electronic databases (PubMed, Medline, Embase, CINAHL, SportDiscus, PsycInfo and Web of Science) in December 2018, and was subsequently updated in May 2020, using the search terms 'fundamental movement skills' OR 'fundamental motor skills'.  Assessment tools identified in this pre-search were included in the subsequent review if they were confirmed to: (i) assess fundamental movement skills, including locomotor, object control and/or stability skills \[[@pone.0237919.ref024]\]; (ii) observationally measure actual FMS competence (i.e. physical, observable abilities); (iii) assess children on a standard battery of tasks which were completed in the presence of an assessor.  Proxy reports and assessments that measured perceived motor competence were therefore excluded from the review.  No restrictions were placed on the health/ development of included participants, as schools are faced with these issues, so any assessment tool that is going to be used in an educational setting would need to be appropriate for use with children both with and without developmental difficulties. 

The titles and abstracts of the results of this pre-search were screened by the lead reviewer (LHE) to identify assessment tools mentioned within them that were being used to assess FMS.  Any studies stating they were assessing FMS but omitting mention of the specific assessment tool in the title or abstract underwent a further full text review. 

Electronic search strategy and information sources {#sec008}
--------------------------------------------------

The search strategy developed (see [S1 Table](#pone.0237919.s002){ref-type="supplementary-material"}) was applied in seven electronic databases (PubMed, Medline, Embase, CINAHL, SportDiscus, PsycInfo and Web of Science) in January 2019, and was then updated in May 2020.  Conference abstracts identified were followed up by searching for the full articles or contacting authors to clarify whether the work had been published. 

Study selection {#sec009}
---------------

For the initial search (Dec 2018), titles and abstracts were screened in their entirety by one reviewer (LHE), and two reviewers (NFS & KLC) independently assessed half of these studies each.  The same process was followed for full text screening to identify eligible studies.  Reviewers were not blind to author or journal information and disagreement between reviewers was resolved through consultation with a fourth reviewer (DDB).  For the update, the same process was repeated with two different reviewers (ME-K & NSF, in place of NFS & KLC). 

Data extraction process & quality assessment {#sec010}
--------------------------------------------

Three reviewers each extracted information from a third of the studies in the review in both the initial search (LHE, KLC & NFS) and the update (ME-K, AO & NSF).  Data extraction and an assessment of the methodological quality of each study were completed using the Consensus-based Standards for the Selection of health Measurement INstruments (COSMIN) checklist \[[@pone.0237919.ref025]\], which outlines guidance for the reporting of the psychometric properties of health-related assessment tools.  Information was extracted on: (i) author details and publication date; (ii) sample size and demographic information related to the sample; (iii) the assessment tool(s) used; (iv) the types of psychometric properties measured by each study; (v) the statistical analyses used to quantify validity or reliability and whether they were measured using classical test theory (CTT) or item-response theory (IRT); (vi) the statistical findings.  Methodological quality ratings for each study were recorded as the percentage of the standards met for the included psychometric properties and generalisability.  When an IRT method was used, a second quality percentage was calculated, based on the COSMIN guidelines for IRT models \[[@pone.0237919.ref025]\].  The lead reviewer (LHE) and a second reviewer (AO) each evaluated half of the studies for methodological quality, with a 10% cross-over to ensure agreement.  Agreement was 100%, so no arbitration was necessary. 

Interpretation of validity and reliability {#sec011}
------------------------------------------

Many studies used different terminologies to describe the same type of validity or reliability, so it was necessary to set a definition for each psychometric property and categorise study outcomes in accordance to the COSMIN checklist \[[@pone.0237919.ref025]\] (see [Table 1](#pone.0237919.t001){ref-type="table"}).  Interpretability and face validity (sub-section of content validity) were not included as these could not be quantified using statistical techniques.  Responsiveness was not included, as this is recognised as being separate to validity or reliability within the COSMIN guidance. 

10.1371/journal.pone.0237919.t001

###### Validity and reliability definitions. 

![]( pone.0237919.t001){#pone.0237919.t001g}

  COSMIN category           Psychometric Property (if different from COSMIN category)                                                                                                                                                                            Definition
  ------------------------- ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ----------------------------------------------------------------------------------------------------------
  Reliability               Inter-Rater Reliability                                                                                                                                                                                                              The level of agreement between different assessors' scores of children on an assessment tool. 
  Intra-Rater Reliability   How consistent an assessor is at scoring children using an assessment tool.                                                                                                                                                           
  Test-retest Reliability   The stability of the children's scores on an assessment tool over a minimum of two time points.                                                                                                                                       
  Internal consistency      The level of agreement between items within an assessment tool.                                                                                                                                                                       
  Content Validity                                                                                                                                                                                                                                               The extent to which an assessment is representative of the components/facets it was designed to measure. 
  Construct Validity        Structural Validity                                                                                                                                                                                                                  The degree to which an assessment tool measures what it was designed to measure. 
  Cross-Cultural Validity   The degree to which an assessment tool and its' normative data can be used to assess FMS in countries other than the one it was designed in.                                                                                          
  Hypotheses Testing        The degree to which scores on assessments are consistent with hypotheses made by authors (e.g. internal relationships between subscales, relationships to scores of other assessment tools or differences between relevant groups.    
  Criterion Validity        Concurrent Validity                                                                                                                                                                                                                  The level of agreement between two assessment tools. 
  Predictive Validity       The degree to which performance on an assessment tool can be used to predict performance on another measure, tested at a later date.                                                                                                  

Due to a large variation in the statistical tests used to assess validity and reliability, a meta-analysis was not possible.  To enable ease of interpretation of studies that utilised statistical analyses, a traffic light system was used (poor, moderate, good and excellent; see [Table 2](#pone.0237919.t002){ref-type="table"}), which allowed such results to be grouped into different bands according to thresholds for these statistical values suggested in previous research.  The results of all outcomes which utilised other statistical tests are described in the text.  For the studies that included multiple metrics for each psychometric property, the traffic light colour used to represent each type of validity or reliability in subsequent tables is a reflection of the mean value of specific FMS related task scores, or subtest scores, as appropriate.  A full breakdown of results for each study can be found in [S2 Table](#pone.0237919.s003){ref-type="supplementary-material"}. 

10.1371/journal.pone.0237919.t002

###### Traffic light system for analysing results of included studies. 

![]( pone.0237919.t002){#pone.0237919.t002g}

                                                            Level of Evidence                         
  --------------------------------------------------------- ------------------- ---------- ---------- ------
  Intraclass Correlation (ICC) \[[@pone.0237919.ref026]\]   \< .5               .5 - .75   .75 - .9   \>.9
  Pearson Correlation \[[@pone.0237919.ref027]\]            \< .3               .3 - .6    .6 - .8    \>.8
  Spearman Correlation \[[@pone.0237919.ref027]\]           \< .3               .3 - .6    .6 - .8    \>.8
  Kappa \[[@pone.0237919.ref028]\]                          \< .6               .6 - .79   .8 - .9    \>.9
  Cronbach's alpha \[[@pone.0237919.ref029]\]               \< .6               .6 - .7    .7 - .9    \>.9

*NB*: For Kappa statistics, the first three thresholds described by the authors ("none", "minimal" and "weak" were combined to form "poor" in the table above \[[@pone.0237919.ref028]\].  For Cronbach's alpha, "unacceptable" and "poor" were combined to be classified as "poor" for the purpose of this review \[[@pone.0237919.ref029]\]. 

Results {#sec012}
=======

Assessment tools {#sec013}
----------------

The pre-search identified 33 possible FMS assessment tools of which three were removed for not meeting criteria 1.  These were Functional Movement Screen \[[@pone.0237919.ref030], [@pone.0237919.ref031]\], Lifelong Physical Activity Skills Battery \[[@pone.0237919.ref032]\], New South Wales Schools Physical Activity and Nutrition Survey \[[@pone.0237919.ref033]\].  Two were removed for failing criteria 3.  These were Fundamental Motor Skill Stage Characteristics/ Component Developmental Sequences \[[@pone.0237919.ref034]\] and the Early Years Movement Skills Checklist \[[@pone.0237919.ref035]\].  Additionally three tools were identified as being the same assessment tool, with the name translated differently- the FMS assessment tool, the Instrument for the Evaluation of Fundamental Movement Patterns and the Test for Fundamental Movement Skills in Adults \[[@pone.0237919.ref036]\].  The APM-Inventory \[[@pone.0237919.ref037]\] and the Passport for Life \[[@pone.0237919.ref038]\] were removed as no information could be found explaining the assessment tool, and authors either did not respond to queries, or no contact information could be found for the author.  This left 24 assessment tools for inclusion in the systematic review, which reviewed studies if they: (i) used assessment tool(s) identified in the pre-search; (ii) measured validity or reliability quantitatively; (iii) sampled children old enough to be in compulsory education within their country.  Studies were not excluded based on sample health or motor competence.  Concurrent validity was only examined between the 24 assessment tools identified in the pre-search. 

Included studies {#sec014}
----------------

Electronic searches initially identified 3749 articles for review. [ Fig 1](#pone.0237919.g001){ref-type="fig"} demonstrates the review process which resulted in 90 studies being selected (for study table see [S2 Table](#pone.0237919.s003){ref-type="supplementary-material"}). 

![ A PRISMA flow diagram \[[@pone.0237919.ref039]\] illustrating the review process.](pone.0237919.g001){#pone.0237919.g001}

Included articles explored the validity and/or reliability of sixteen of the assessment tools identified in the pre-search.  The search did not identify any articles for the remaining eight assessment tools (see [Table 3](#pone.0237919.t003){ref-type="table"}), so the reliability and validity of these measures could not be evaluated in this review.  Only nine of the assessment tools identified in the pre-search assess all three components of FMS: locomotion, object control and balance \[[@pone.0237919.ref024]\]: the Bruininks-Oseretsky Test of Motor Proficiency (BOT) \[[@pone.0237919.ref040], [@pone.0237919.ref041]\], FMS Polygon \[[@pone.0237919.ref042]\], Get Skilled Get Active (GSGA) \[[@pone.0237919.ref043]\], Peabody Developmental Motor Scale (PDMS) (Folio & Fewell, 1983, 2000), PLAYfun \[[@pone.0237919.ref044]\], PLAYbasic \[[@pone.0237919.ref045]\], Preschooler Gross Motor Quality Scale (PGMQ) \[[@pone.0237919.ref046]\], Stay in Step Screening Test \[[@pone.0237919.ref047]\], and the Teen Risk Screen \[[@pone.0237919.ref048]\] of which three were product and five were process-oriented. [ Fig 2](#pone.0237919.g002){ref-type="fig"} shows a breakdown of the number of assessment tools which measure each aspect of FMS.  Other aspects of motor development (e.g. the MABC has a manual dexterity subscale) were measures by the included assessment tools, but this review specifically focused on FMS. 

![ Graphical representation of the number of assessment tools which evaluate each of the three aspects of FMS.](pone.0237919.g002){#pone.0237919.g002}

10.1371/journal.pone.0237919.t003

###### The psychometric properties measured for each assessment tool found to measure FMS proficiency. 

![]( pone.0237919.t003){#pone.0237919.t003g}

  ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  Assessment Tool                                                                                                              FMS Measured ([subscales]{.ul})                                                                                                     Outcome(s)                                                                                                                                               Number of Validity /Reliability Studies   Types of Validity and Reliability Assessed
  ---------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------- --------------------------------------------
  Athletics Skills Track (AST) ^a^ \[[@pone.0237919.ref098]\]                                                                  AST-1: Crawl, hop, jump, throw, catch, kick, running backwards\                                                                     Time taken to complete the course                                                                                                                        **1**                                     Test-Retest Reliability\
                                                                                                                               AST-2: crawl, walk, jump, roll, hopping                                                                                                                                                                                                                                                                                                Internal consistency

  Bruininks-Oseretsky Test of Motor Proficiency (BOT) ^a^ \[[@pone.0237919.ref040], [@pone.0237919.ref041]\]                   [Balance:]{.ul} static balances (e.g. standing on one leg) and dynamic balance (e.g. walking along a line)\                         Time taken to complete tasks, number of tasks completed in a set time limit                                                                              **22**                                    Inter-Rater Reliability\
                                                                                                                               [Running speed and agility]{.ul}: running, hopping, jumping\                                                                                                                                                                                                                                                                           Test-Retest Reliability\
                                                                                                                               [Upper limb coordination:]{.ul} catching, dribbling, throwing                                                                                                                                                                                                                                                                          Internal Consistency\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Structural Validity\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Concurrent Validity\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Cross-Cultural Validity\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Hypothesis testing validity

  Canadian Agility and Movement Skill Assessment (CAMSA) ^a,b^ \[[@pone.0237919.ref092]\]                                      Jump, slide, catch, skip, hop, kick and run                                                                                         Time taken to complete the course (converted to points range) and a performance assessment for each skill                                                **3**                                     Inter-Rater Reliability\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Intra-Rater Reliability\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Test-Retest Reliability\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Concurrent Validity

  Children\'s Motor Skills Protocol (CMSP) ^b^ \[[@pone.0237919.ref099]\]                                                      [Locomotor]{.ul}: run, broad jump, slide, gallop, leap, hop\                                                                        Number of movement characteristics observed for each skill                                                                                               **0**                                     N/A
                                                                                                                               [Object control]{.ul}: overarm throw, underhand roll, kick, catch, stationary strike, stationary dribble                                                                                                                                                                                                                               

  Fundamental Motor Skills Test Package (EUROFIT, FMS Test Package) ^a^ \[[@pone.0237919.ref100], [@pone.0237919.ref101]\]     Balance, jump and run                                                                                                               Time taken to complete 20m shuttle run, time can stand on one leg, and distance jumped                                                                   **0**                                     N/A

  Fundamental Movement Skill Polygon (FMS Polygon) ^a^ \[[@pone.0237919.ref042]\]                                              [Space Covering:]{.ul} Crawling, rolling, running, beam walking,\                                                                   Time taken to complete tasks                                                                                                                             **1**                                     Intra-Rater Reliability\
                                                                                                                               [Surmounting Obstacles:]{.ul} skipping, hopping, jumping\                                                                                                                                                                                                                                                                              Structural Validity\
                                                                                                                               [Object Control:]{.ul} Dribble, throw, catch                                                                                                                                                                                                                                                                                           Concurrent Validity

  Furtado-Gallagher Computerized Observational Movement Pattern Assessment System (FG-COMPASS)^b^ \[[@pone.0237919.ref102]\]   [Locomotor:]{.ul}\                                                                                                                  Patterns of movement characteristics for each skill                                                                                                      **1**                                     Inter-Rater Reliability
                                                                                                                               Hopping, jumping, leaping, skipping, sliding\                                                                                                                                                                                                                                                                                          
                                                                                                                               [Manipulative:]{.ul}\                                                                                                                                                                                                                                                                                                                  
                                                                                                                               Hitting, catching, kicking, dribbling, throwing                                                                                                                                                                                                                                                                                        

  Get Skilled Get Active (GSGA)^b^ \[[@pone.0237919.ref043]\]                                                                  Static balance, jump, run, catch, hop, leap, gallop, kick, skip, hit, throw, dodge                                                  Ability to consistently complete patterns of movements for each skill in a variety of environments/ contexts                                             **1**                                     Concurrent Validity

  Instrument for the Evaluation of Fundamental Movement Patterns ^b^\[[@pone.0237919.ref036]\]                                 [Locomotor:]{.ul} run, jump, gallop, slide, hop\                                                                                    Number of points (one per criterion met per skill)                                                                                                       **0**                                     N/A
                                                                                                                               [Object Control:]{.ul} bounce, catch, kick, strike, throw                                                                                                                                                                                                                                                                              

  Körperkoordinationstest für Kinder (KTK) ^a^ \[[@pone.0237919.ref103]--[@pone.0237919.ref105]\]                              [Walking backwards along beams of varying widths]{.ul}\                                                                             Number of steps walked along the beam, number of successful hops/ jumps/ movements                                                                       **10**                                    Inter-Rater Reliability\
                                                                                                                               [Hopping for height]{.ul}\                                                                                                                                                                                                                                                                                                             Structural Validity\
                                                                                                                               [Jumping sideways over a slat]{.ul}\                                                                                                                                                                                                                                                                                                   Concurrent Validity\
                                                                                                                               [Moving sideways on boards]{.ul}                                                                                                                                                                                                                                                                                                       Internal Consistency\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Hypothesis testing validity

  Motoriktest für vier- bis sechsjärige Kinder (MOT 4--6) ^a^ \[[@pone.0237919.ref106]\]                                       [Gross Motor:]{.ul} jumping, walking, catching, throwing, hopping                                                                   Number of jumps completed, time taken to complete tasks etc.  Raw scores are converted into a 3 level ranking scale: 0 (not mastered)-- 2 (mastered)      **4**                                     Structural Validity\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Concurrent Validity\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Hypothesis testing validity

  Movement Assessment Battery for Children ^a^ \[[@pone.0237919.ref107], [@pone.0237919.ref108]\]                              [Aiming and catching]{.ul}\                                                                                                         Number of successful attempts, length of time balances can be held for                                                                                   **37**                                    Inter-Rater Reliability\
                                                                                                                               Throwing, catching\                                                                                                                                                                                                                                                                                                                    Intra-Rater Reliability\
                                                                                                                               [Balance:]{.ul} static balance (e.g. on one leg), dynamic balance (e.g. walking along the line, jumping, hopping)                                                                                                                                                                                                                      Test-Retest Reliability\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Internal Consistency\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Predictive Validity\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Content Validity\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Structural Validity\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Cross-Cultural Validity\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Concurrent Validity\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Hypothesis testing validity

  Objectives-Based Motor-Skill Assessment Instrument ^b^ \[[@pone.0237919.ref109]\]                                            run, gallop, hop, skip, jump, leap, slide, strike, bounce, catch, kick, throw                                                       The number of qualitative motor behaviours exhibited across the FMS measured (/45)                                                                       **0**                                     N/A

  Ohio State University Scale for intra-Gross Motor Assessment (OSU-SIGMA) ^b^ \[[@pone.0237919.ref110]\]                      [Locomotor:]{.ul} walking, running, jumping, hopping, skipping, climbing\                                                           Levels of development for each skill 1 (least mature)-- 4 (mature functional pattern) based on qualitative assessment of movement patterns               **0**                                     N/A
                                                                                                                               [Object control:]{.ul} throwing, catching, striking, kicking                                                                                                                                                                                                                                                                           

  Peabody Developmental Motor Scale (PDMS)^b^ \[[@pone.0237919.ref111], [@pone.0237919.ref112]\]                               [Stationary]{.ul}\                                                                                                                  Score of 0--2 as to the level of skill shown for each FMS (not demonstrated, emerging, proficient                                                        **1**                                     Concurrent Validity
                                                                                                                               [Locomotion:]{.ul} crawling, walking, running, hopping, jumping\                                                                                                                                                                                                                                                                       
                                                                                                                               [Object manipulation:]{.ul} throwing, catching                                                                                                                                                                                                                                                                                         

  PE Metrics ^a,b^ \[[@pone.0237919.ref113], [@pone.0237919.ref114]\]                                                          Throwing, catching, dribbling, kicking, striking\                                                                                   Score of 0--4 for form (how well the movement is executed) and success (the outcome of the movement)                                                     **1**                                     Structural Validity
                                                                                                                               Hopping, jumping, galloping, sliding, running, skipping                                                                                                                                                                                                                                                                                

  PLAYbasic ^b^ \[[@pone.0237919.ref045]\]                                                                                     [Locomotor:]{.ul} run, hop\                                                                                                         Levels of development for each FMS--developing (initial or emerging) or acquired (competent or proficient)                                               **1**                                     Inter-Rater Reliability\
                                                                                                                               [Throw]{.ul}\                                                                                                                                                                                                                                                                                                                          Internal Consistency\
                                                                                                                               [Kick]{.ul}\                                                                                                                                                                                                                                                                                                                           Concurrent Validity
                                                                                                                               [Balance]{.ul} (dynamic- heel to toe backwards)                                                                                                                                                                                                                                                                                        

  PLAYfun^b^ \[[@pone.0237919.ref045]\]                                                                                        Runnings: run a square, run there and back, run, jump and land on two feet\                                                         Levels of development for each FMS--developing (initial or emerging) or acquired (competent or proficient)                                               **2**                                     Inter-rater reliability\
                                                                                                                               [Locomotion:]{.ul} skip, gallop, hop, jump\                                                                                                                                                                                                                                                                                            Structural validity\
                                                                                                                               [Upper body object control:]{.ul} overhand throw, strike, one handed catch, stationary dribble\                                                                                                                                                                                                                                        Internal Consistency\
                                                                                                                               [Lower body object control:]{.ul} kick a ball, foot dribble\                                                                                                                                                                                                                                                                           Concurrent Validity\
                                                                                                                               [Balance:]{.ul} walk heel-to-toe forwards, walk heel-to-toe backwards,                                                                                                                                                                                                                                                                 Hypothesis Testing Validity

  Preschooler gross motor quality scale (PGMQ)^b^ \[[@pone.0237919.ref046]\]                                                   [Locomotion:]{.ul} Run, jump, hop, slide, gallop, leap\                                                                             Number of qualitative qualities for each FMS each child demonstrates                                                                                     **0**                                     N/A
                                                                                                                               [Object manipulation:]{.ul} throw, catch, kick, bounce, strike\                                                                                                                                                                                                                                                                        
                                                                                                                               [Static balance:]{.ul} one leg balance, tandem one leg balance, walking along the line forwards, walking along the line backwards                                                                                                                                                                                                      

  Smart Start ^b^ \[[@pone.0237919.ref115]\]                                                                                   [Locomotor:]{.ul} run, gallop, hop, leap, jump, slide\                                                                              Whether elements of each skill were completed (1 = yes, 0 = no)                                                                                          **0**                                     N/A
                                                                                                                               [Object control:]{.ul} strike, bounce, catch, kick, throw                                                                                                                                                                                                                                                                              

  Teen Risk Screen ^b^ \[[@pone.0237919.ref048]\]                                                                              [Posture & Stability (Axial Movement):]{.ul} sitting, standing, bending, stretching, twisting, turning, swinging\                   Extent to which each skill can be performed according to guidelines\                                                                                     **1**                                     Internal Consistency\
                                                                                                                               [Posture & Stability (Dynamic Movement):]{.ul} body rolling, starting and stopping, dodging and balance\                            (0 = cannot perform the skill according to guidelines, 1 = can perform the skill but not according to the guidelines, 2 = can perform the skill)                                                   Structural Validity\
                                                                                                                               [Locomotor Skills (Single Skills):]{.ul} walking, running, leaping, jumping and hopping\                                                                                                                                                                                                                                               Test-Retest Reliability
                                                                                                                               [Locomotor Skills (Combinations):]{.ul} galloping, sliding and skipping\                                                                                                                                                                                                                                                               
                                                                                                                               [Manipulative Skills (Sending Away):]{.ul} carrying, dribbling\                                                                                                                                                                                                                                                                        
                                                                                                                               [Manipulative Skills (Maintaining Possession):]{.ul} catching                                                                                                                                                                                                                                                                          

  Test of Gross Motor Development (TGMD)^b^ \[[@pone.0237919.ref116]--[@pone.0237919.ref118]\]                                 [Locomotor]{.ul}: run, gallop, jump, hop, skip, leap, slide\                                                                        The number of qualitative motor behaviours exhibited for each of the FMS measured                                                                        **34**                                    Inter-Rater Reliability\
                                                                                                                               [Object Control]{.ul}: strike, dribble, catch, kick, throw                                                                                                                                                                                                                                                                             Intra-Rater Reliability\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Test-Retest Reliability\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Internal Consistency\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Content Validity\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Structural Validity\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Cross-Cultural Validity\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Concurrent Validity\
                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Hypothesis Testing Validity

  Victorian Fundamental Movement Skills Assessment Instrument ^b^ \[[@pone.0237919.ref119]\]                                   Catch, kick, run, jump, throw, bounce, leap, dodge, strike                                                                          The number of components of each FMS a child has mastered                                                                                                **1**                                     Concurrent Validity

  Stay in Step Screening Test ^a^ \[[@pone.0237919.ref047]\]                                                                   Static balance (one leg), bounce, catch, hop, run                                                                                   Duration balance is held for, number of completed throws/catches in a specified timeframe, distance hopped, time taken to complete task (e.g. 50m run)   **0**                                     N/A
  ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

NB: ^a^ = product-oriented, ^b^ = process-oriented

Participants {#sec015}
------------

The included studies recruited a total of 51,408 participants aged between three and seventeen years of age, with sample sizes that ranged from 9 to 5210 (mean = 556 \[SD = 1000\] median = 153 \[IQR = 652\]).  Twenty-four studies included additional sample demographics, with seven studies recruiting children with movement difficulties \[[@pone.0237919.ref049], [@pone.0237919.ref050]\], Cerebral Palsy \[[@pone.0237919.ref051], [@pone.0237919.ref052]\] or Developmental Coordination Disorder \[[@pone.0237919.ref053]--[@pone.0237919.ref055]\].  Two studies included participants with Autistic Spectrum Disorder \[[@pone.0237919.ref056], [@pone.0237919.ref057]\], and another study recruited children from special educational needs (SEN) schools \[[@pone.0237919.ref058]\].  Eight defined themselves as sampling children with learning and/or attentional problems \[[@pone.0237919.ref054], [@pone.0237919.ref059]--[@pone.0237919.ref065]\], three studies recruited children with visual impairments \[[@pone.0237919.ref066]--[@pone.0237919.ref068]\], and the sample of one study included children with a disability or chronic health condition \[[@pone.0237919.ref069]\].  Information regarding socioeconomic status (SES) was included in one article which stated they sampled from low SES \[[@pone.0237919.ref070]\], while two studies recruited samples from indigenous populations (in Australia and Canada, respectively) \[[@pone.0237919.ref044], [@pone.0237919.ref071]\], the latter of which focused on the recruitment of children whose mothers drank alcohol during pregnancy \[[@pone.0237919.ref071]\].  Studies evaluating the validity and reliability of FMS assessment tools were conducted in 29 countries, with Australia hosting the most studies (13) \[[@pone.0237919.ref050], [@pone.0237919.ref056], [@pone.0237919.ref071]--[@pone.0237919.ref077]\], followed by Brazil (12 studies) \[[@pone.0237919.ref053], [@pone.0237919.ref057], [@pone.0237919.ref066], [@pone.0237919.ref070], [@pone.0237919.ref078]--[@pone.0237919.ref085]\] and the USA (nine studies).  Eight studies were carried out in Belgium \[[@pone.0237919.ref049], [@pone.0237919.ref058], [@pone.0237919.ref063], [@pone.0237919.ref086]--[@pone.0237919.ref089]\] and seven in Canada \[[@pone.0237919.ref043], [@pone.0237919.ref054], [@pone.0237919.ref060], [@pone.0237919.ref090]--[@pone.0237919.ref094]\].  The remaining 23 countries spanned Europe (23 studies from 15 countries), Asia (10 studies from 7 countries), South America (one study from Chile) and Africa (one study conducted in South Africa).  Two studies did not provide any information regarding where the sample was recruited from \[[@pone.0237919.ref095], [@pone.0237919.ref096]\]. 

COSMIN quality assessment {#sec016}
-------------------------

[Fig 3](#pone.0237919.g003){ref-type="fig"} shows the results of the generalisability subscale of the quality assessment for the included studies.  The COSMIN checklist \[[@pone.0237919.ref025]\] revealed multiple issues with reporting in the included studies, with 85% of studies not providing enough information to make a judgement about missing responses, and 76% of studies failing to report the language with which the assessment tool was conducted.  Additionally, over a third of the studies included in this review did not adequately describe the method of recruiting participants, the age of participants, or the setting in which testing was conducted. 

![ Summary of the generalisability subscale of the COSMIN checklist.](pone.0237919.g003){#pone.0237919.g003}

Assessment tool categorisation {#sec017}
------------------------------

Observational assessment methods were defined categorically as either assessing FMS using a "process" or "product-oriented" methodology \[[@pone.0237919.ref097]\].  Process-oriented measures require decisions to be made as to whether children are meeting specific performance criteria whilst completing skills (e.g. when running, is the non-support leg is bent at a ninety degree angle?).  Product-oriented assessments focus on the outcome of movements (e.g. how quickly can a child can complete a movement?).  Given these two different approaches to measuring FMS, which can used for different purposes in the literature, they were distinguished for this review.  Of the 24 assessment tools identified, nine were product-oriented, thirteen were process-oriented, and two assessment tools included both process and product methodologies (see [Table 3](#pone.0237919.t003){ref-type="table"}). 

Product oriented assessments {#sec018}
----------------------------

Despite the pre-search identifying nine product-oriented assessments in the FMS literature, the systematic review only identified research on the validity and reliability of six of these measures (described below).  No evaluations of the psychometric properties of any of the following assessments were found: the APM inventory \[[@pone.0237919.ref037]\], the FMS Test Package \[[@pone.0237919.ref100], [@pone.0237919.ref101]\] and the Stay in Step Screening Test \[[@pone.0237919.ref047]\]. 

### Movement Assessment Battery for Children (MABC) {#sec019}

Twenty-three studies evaluated the validity and/or reliability of the MABC or MABC-2.  All of the ten COSMIN categories this review focused on (see [Table 1](#pone.0237919.t001){ref-type="table"}), were evaluated for the MABC.  Overall there was strong evidence for inter-rater reliability for these assessments ([Table 4](#pone.0237919.t004){ref-type="table"}).  However, there were more mixed results for other aspects of validity and reliability, with the weakest evidence being found in support for internal consistency.  Intra-rater reliability was only looked at in two studies \[[@pone.0237919.ref083], [@pone.0237919.ref120]\] with poor intra-rater reliability (ICC = .49 for both the balance and aiming and catching subtest) demonstrated in the study exploring this construct in Norwegian children \[[@pone.0237919.ref120]\].  There was good evidence for test-retest reliability, with only one out of five studies in a sample of teenagers \[[@pone.0237919.ref121]\] finding moderate correlations (mean ICC for FMS skills = .74).  An adapted version of the MABC-2 was also tested (e.g. increasing the colour contrast on the ball), with results showing that the modified version was a reliable assessment tool for use with children with low vision (inter-rater reliability--ICC = .97; test-retest reliability--ICC = .96; internal consistency- Cronbach's alpha ranged from 0.790 to 0.868) \[[@pone.0237919.ref066]\].  Strong evidence for content validity was found for both the Brazilian \[[@pone.0237919.ref083]\] and the Chinese \[[@pone.0237919.ref122]\] versions of the assessment tool, with concordance rates amongst experts ranging from 71.8%-99.2%.  Additionally, one study found that children with Asperger syndrome perform worse on all three subtests of the MABC than typically developing children, as hypothesised \[[@pone.0237919.ref057]\]. 

10.1371/journal.pone.0237919.t004

###### Reliability and validity of the MABC. 

![]( pone.0237919.t004){#pone.0237919.t004g}

                                                                   Reliability   Validity         
  --------------------------------------------------- ------------ ------------- ---------- -- -- --
  Chow et al.  \[[@pone.0237919.ref121]\]              **MABC**                                    
  Croce et al.  \[[@pone.0237919.ref123]\]                                                         
  Ellinoudis et al.  \[[@pone.0237919.ref124]\]                                                    
  Smits-Engelsman et al.  \[[@pone.0237919.ref049]\]                                               
  Bakke et al.  \[[@pone.0237919.ref066]\]             **MABC-2**                                  
  Borremans et al.  \[[@pone.0237919.ref057]\]                                                     
  Darsaklis et al.  \[[@pone.0237919.ref096]\]                                                     
  Holm et al.  \[[@pone.0237919.ref120]\]                                                          
  Hua et al.  \[[@pone.0237919.ref122]\]                                                           
  Jaikaew et al.  \[[@pone.0237919.ref125]\]                                                       
  Kita et al.  \[[@pone.0237919.ref126]\]                                                          
  Valentini et al.  \[[@pone.0237919.ref083]\]                                                     
  Wuang et al.  \[[@pone.0237919.ref055]\]                                                         

*NB*: IeR = interrater IaR = intra rater, TR = test-retest, IC = internal consistency, St = Structural, Ct = content, Pr = predictive.  $\blacksquare$ = poor (ICC \< .5, *r* \< .3, *κ* \< .6, *α* \< .6), $\blacksquare$ = moderate (ICC = .5 -.75, *r* = .3 - .6, *κ* = .6 - .79, *α* = .6 - .7), $\blacksquare$ = good, (ICC = .75 -.9, *r* = .6 - .8, *κ* = .8 - .9, *α* = .7 - .9) $\blacksquare$ = excellent validity/reliability (ICC \>.9, *r* \> 8, *κ* \>.9, *α* \> .9). 

Cross-cultural validity was studied in four papers, looking at Swedish, Spanish, Italian, Dutch and Japanese samples in comparison to US or UK norms \[[@pone.0237919.ref088], [@pone.0237919.ref127]--[@pone.0237919.ref129]\].  Results showed that UK norms were not suitable for use to evaluate the performance of Italian children, as significant differences were found for eleven of the twenty seven items on the MABC-2 \[[@pone.0237919.ref129]\].  Differences were also found between the performance of UK children and Dutch children, however these differences were not statistically significant.  The US standardised sample was found to be valid for a Swedish sample \[[@pone.0237919.ref127]\], but not for a Spanish sample, for which US norms left a large proportion of the sample below the 15^th^ percentile \[[@pone.0237919.ref128]\]. 

Structural validity was assessed by ten studies, with six finding evidence for a three factor (manual dexterity, aiming & catching and balance) model \[[@pone.0237919.ref078], [@pone.0237919.ref122], [@pone.0237919.ref126], [@pone.0237919.ref129]--[@pone.0237919.ref131]\].  One study found a four factor solution, with a general factor for age band 1, four factors with balance split into static and dynamic for age band 2, and a 3 factor correlated model for age band 3 \[[@pone.0237919.ref132]\].  Similarly, another study found evidence for a bifactor model with one general factor, and three sub-factors for age band one \[[@pone.0237919.ref081]\].  Evidence was also found for a five factor solution, with balance and manual dexterity each split into two factors \[[@pone.0237919.ref124]\].  An adolescent study found a two factor model (manual dexterity and aiming and catching) was more appropriate as ceiling effects were evident on balance tasks \[[@pone.0237919.ref133]\]. 

The results of the COSMIN quality assessment of MABC studies show that two studies which found excellent results, had the lowest quality ratings, in which they met 13% and 29% of generalisability and inter-rater reliability criteria respectively \[[@pone.0237919.ref096], [@pone.0237919.ref125]\].  Additionally, the singular study which found MABC normative data to be valid in another country only had a quality rating of 39% \[[@pone.0237919.ref127]\].  The MABC study with the best quality rating (81% of criteria met), only found moderate results for internal consistency \[[@pone.0237919.ref126]\], and the single study which found that MABC norms data are cross-culturally valid, only had a quality rating of 39%.  When considering COSMIN quality ratings alongside the results of these studies, it would suggest that caution should be taken when interpreting the results of studies exploring the psychometric properties of the MABC. 

### Bruininks-Oseretsky Test of Motor Proficiency (BOT) {#sec020}

Twelve studies stated that they explored the validity and reliability of the BOT, BOT-2 or BOT-2 Short Form (SF), of which six reported results that could be quantified into poor, moderate, good and excellent evidence, which are detailed in [Table 5](#pone.0237919.t005){ref-type="table"}.  Three studies looked at the inter-rater reliability of the BOT, all of which found good evidence in support of this aspect of reliability \[[@pone.0237919.ref054], [@pone.0237919.ref071], [@pone.0237919.ref096]\], however one of these studies provided no information about the sample, including size and demographic information \[[@pone.0237919.ref096]\].  The results for test-retest reliability were more mixed than for the MABC, with the two studies finding low correlations on scores between tests sampling from children with Cerebral Palsy (ICC = .4) \[[@pone.0237919.ref052]\] and children living in aboriginal communities in Australia (mean ICC for FMS = .097) \[[@pone.0237919.ref071]\].  One study did show evidence of the BOT being a reliable measure of FMS in children with intellectual deficits \[[@pone.0237919.ref065]\].  One study explored the cross-cultural validity of the BOT-2 norm scores with a large Brazilian sample (n = 931) and found mixed results \[[@pone.0237919.ref079]\].  Results showed that Brazilian children outperformed the BOT normative data on bilateral coordination, balance, upper-limb coordination, and running speed and agility subtests, but similar percentile curves were found for both populations on upper limb coordination and balance subtests \[[@pone.0237919.ref079]\]. 

10.1371/journal.pone.0237919.t005

###### Validity and reliability of the BOT. 

![]( pone.0237919.t005){#pone.0237919.t005g}

                                                                      Reliability   Validity         
  ---------------------------------------------------- -------------- ------------- ---------- -- -- --
  Iatridou & Dionyssiotis \[[@pone.0237919.ref051]\]   **BOT**                                       
  Liao et al.  \[[@pone.0237919.ref052]\]                                                             
  Wilson et al.  \[[@pone.0237919.ref054]\]                                                           
  Darsaklis et al.  \[[@pone.0237919.ref096]\]          **BOT-2**                                     
  Wuang & Su \[[@pone.0237919.ref065]\]                                                              
  Lucas et al.  \[[@pone.0237919.ref071]\]              **BOT-2 SF**                                  

*NB*: IeR = interrater IaR = intra rater, TR = test-retest, IC = internal consistency, St = Structural, Ct = content, Pr = predictive.  $\blacksquare$ = poor (ICC \< .5, *r* \< .3, *κ* \< .6, *α* \< .6), $\blacksquare$ = moderate (ICC = .5 -.75, *r* = .3 - .6, *κ* = .6 - .79, *α* = .6 - .7), $\blacksquare$ = good, (ICC = .75 -.9, *r* = .6 - .8, *κ* = .8 - .9, *α* = .7 - .9) $\blacksquare$ = excellent validity/reliability (ICC \>.9, *r* \> 8, *κ* \>.9, *α* \> .9)

Five studies explored the structural validity of the BOT.  The BOT-2 SF was also found to have good structural validity once mis-fitting items were removed for children aged 6--8 years, but ceiling effects were found for older children (aged 9--11 years)\[[@pone.0237919.ref134]\].  Two studies exploring structural validity found good evidence utilising Rasch analysis, with results indicative of unidimensionality, with the overarching factor accounting for 99.8% \[[@pone.0237919.ref064]\] and 82.9% \[[@pone.0237919.ref073]\] of the variance in test scores for children with intellectual deficits (BOT), and typically developing children (BOT-BF), respectively.  Similarly to the results of the Rasch studies, one additional study found that the four subscales were correlated, so a bifactor model, with an overarching motor skill factor, and four correlated sub-factors \[[@pone.0237919.ref081]\].  When the subscales and composite scales were evaluated separately using Rasch analysis, one study found multiple issues with fine motor integration, bilateral coordination, balance and body coordination which limit the justification of their use including multi-dimensional scales, items working differently for males and females, disordered item difficulty ratings, and/or the ability of the subscale/ composite score to differentiate between abilities \[[@pone.0237919.ref135]\]. 

The quality of the studies evaluating the validity and reliability of the BOT may have influenced the results though, as the study with the greatest quality rating (83%) found good results for inter-rater reliability \[[@pone.0237919.ref071]\], but two studies with lower ratings (13% \[[@pone.0237919.ref096]\] and 53% \[[@pone.0237919.ref054]\]) reported excellent results for this psychometric property, suggesting that reliability scores may have been inflated by poorer quality studies.  Additionally, the reviewed BOT studies only evaluated seven of the ten COSMIN categories (see [Table 3](#pone.0237919.t003){ref-type="table"}). 

### Other product-oriented assessment tools {#sec021}

Three studies evaluated the validity and reliability of the Körperkoordinationstest für Kinder (KTK) \[[@pone.0237919.ref077], [@pone.0237919.ref080], [@pone.0237919.ref136]\].  Two studies looked at the structural validity of the KTK, and found adequate evidence to support a one factor structure, interpreted as representing "body coordination" \[[@pone.0237919.ref077], [@pone.0237919.ref080]\].  The internal consistency of the KTK was consistently found to be good across samples in Finland, Portugal and Belgium (α ranged from .78 - .83), however, as hypothesised there were significant differences between groups, in which children from Portugal and Belgium performed worse than Finnish participants \[[@pone.0237919.ref136]\].  Additionally, there was evidence of high inter-rater reliability (94% agreement) \[[@pone.0237919.ref077]\]. 

Two studies evaluated the validity and reliability of the Athletic Skills Track (AST) \[[@pone.0237919.ref098], [@pone.0237919.ref137]\].  The results of both studies suggest that the AST has good test-retest reliability with intraclass correlations ranging from .8 \[[@pone.0237919.ref137]\] to .88 \[[@pone.0237919.ref098]\].  Cronbach's alpha was used in one of these studies to examine internal consistency, with results ranging from .7-.76 for the three versions of the AST \[[@pone.0237919.ref137]\].  It is, however, important to note that only two psychometric properties from the COSMIN checklist \[[@pone.0237919.ref025]\] were evaluated, and the quality ratings for these studies were lower than 60%.  The psychometric properties of the FMS Polygon were tested in one study \[[@pone.0237919.ref138]\], finding strong evidence for intra-rater reliability (ICC = .98).  Factor analysis also explored the structure of the assessment tool, revealing four factors: object control (tossing and catching a volleyball), surmounting obstacles (running across obstacles), resistance overcoming obstacles (carrying a medicine ball) and space covering skills (straight running).  These psychometric properties of the FMS Polygon, should however, be interpreted with caution, as the above study only had a quality rating of 43% \[[@pone.0237919.ref138]\]. 

The structural validity of the MOT 4--6 was evaluated by one study with a high quality rating (79%) using Rasch analysis, which established four of the items had disordered thresholds and needed to be removed from the assessment (grasping a tissue with a toe, catching a tennis ring, rolling sideways over the floor and twist jump in/out of a hoop).  Results also showed that with one additional item removed (jumping on one leg into a hoop), there was an acceptable global model fit for the MOT 4--6 \[[@pone.0237919.ref139]\]. 

Process-oriented assessments {#sec022}
----------------------------

Thirteen process-oriented assessment tools were identified by the pre-search as measuring FMS.  Of these, seven had been evaluated for validity and reliability (described below).  No research was found evaluating the psychometric properties of the: Children\'s Motor Skills Protocol (CMSP)\[[@pone.0237919.ref099]\], Instrument for the Evaluation of Fundamental Movement Patterns \[[@pone.0237919.ref036]\], Objectives-Based Motor-Skill Assessment Instrument \[[@pone.0237919.ref109]\], Ohio State University Scale for intra-Gross Motor Assessment (OSU-SIGMA) \[[@pone.0237919.ref110]\], Preschooler Gross Motor Quality Scale (PGMQ) \[[@pone.0237919.ref046]\] and Smart Start \[[@pone.0237919.ref115]\]. 

### Test of Gross Motor Development (TGMD) {#sec023}

The results of twenty-one studies which evaluated the psychometric properties of various versions of TGMD can be found in [Table 6](#pone.0237919.t006){ref-type="table"}.  Nine out of ten COSMIN psychometric properties were evaluated by TGMD studies.  Consistently good evidence for inter-rater and intra-rater reliability was observed, with only one study finding less than 'good' (moderate) correlations when testing sessions were video recorded \[[@pone.0237919.ref140]\].  One study evaluated these aspects of reliability using a Content Validity Index (CVI) and found good evidence for both inter and intra-rater reliability when testing Chilean children, with CVIs ranging from .86 to .91 \[[@pone.0237919.ref141]\].  An additional study evaluated the inter and intra-rater reliability of the TGMD second and third editions using percentage agreement \[[@pone.0237919.ref069]\].  Results showed agreement for inter-rater reliability was 88% and 87% for the TGMD-2 and TGMD-3 respectively, and for intra-rater reliability the percentage agreement was 98% for the TGMD-2 and 95% for the TGMD-3 \[[@pone.0237919.ref069]\].  Fewer studies examined the test-retest reliability of the TGMD, but those that did demonstrated that for the TGMD-2 \[[@pone.0237919.ref063], [@pone.0237919.ref068], [@pone.0237919.ref082], [@pone.0237919.ref142], [@pone.0237919.ref143]\], a short version of the TGMD-2 modified for Brazilian children \[[@pone.0237919.ref084]\] and the TGMD-3 \[[@pone.0237919.ref056], [@pone.0237919.ref085], [@pone.0237919.ref144], [@pone.0237919.ref145]\] participants score similarly when they are tested on multiple occasions.  Strong test-retest reliability was evidenced with a CVI of .88 \[[@pone.0237919.ref141]\] and Bland Altmann plots found 95% confidence intervals were within one standard deviation \[[@pone.0237919.ref077]\], with .96 agreement ratio \[[@pone.0237919.ref146]\].  Evidence for internal consistency was more mixed, but there was strong evidence that all items in the TGMD-3, once modified for children with ASD and visual impairments could still measure FMS as an overarching construct \[[@pone.0237919.ref056], [@pone.0237919.ref067]\].  Evidence for good internal consistency of the TGMD was also found when testing children with intellectual deficits \[[@pone.0237919.ref059]\]. 

10.1371/journal.pone.0237919.t006

###### Validity and reliability of the TGMD. 

![]( pone.0237919.t006){#pone.0237919.t006g}

                                                                Reliability   Validity         
  --------------------------------------------- --------------- ------------- ---------- -- -- --
  Allen et al.  \[[@pone.0237919.ref056]\]       **TGMD-2**                                     
  Barnett et al.  \[[@pone.0237919.ref072]\]                                                    
  Capio et al.  \[[@pone.0237919.ref059]\]                                                      
  Garn & Webster \[[@pone.0237919.ref147]\]                                                    
  Houwen et al.  \[[@pone.0237919.ref068]\]                                                     
  Issartel et al.  \[[@pone.0237919.ref142]\]                                                   
  Kim et al.  \[[@pone.0237919.ref143]\]                                                        
  Lopes et al.  \[[@pone.0237919.ref146]\]                                                      
  Simons et al.  \[[@pone.0237919.ref063]\]                                                     
  Valentini et al.  \[[@pone.0237919.ref082]\]                                                  
  Ward et al.  \[[@pone.0237919.ref148]\]                                                       
  Valentini et al.  \[[@pone.0237919.ref084]\]   **TGMD-2 SF**                                  
  Allen et al.  \[[@pone.0237919.ref056]\]       **TGMD-3**                                     
  Brian et al.  \[[@pone.0237919.ref067]\]                                                      
  Estevan et al.  \[[@pone.0237919.ref149]\]                                                    
  Maeng et al.  \[[@pone.0237919.ref150]\]                                                      
  Magistro et al.  \[[@pone.0237919.ref151]\]                                                   
  Rintala et al.  \[[@pone.0237919.ref140]\]                                                    
  Valentini et al.  \[[@pone.0237919.ref085]\]                                                  
  Wagner et al.  \[[@pone.0237919.ref144]\]                                                     
  Webster & Ulrich \[[@pone.0237919.ref145]\]                                                  

*NB*: IeR = interrater IaR = intra rater, TR = test-retest, IC = internal consistency, St = Structural, Ct = content, Pr = predictive.  $\blacksquare$ = poor (ICC \< .5, *r* \< .3, *κ* \< .6, *α* \< .6), $\blacksquare$ = moderate (ICC = .5 -.75, *r* = .3 - .6, *κ* = .6 - .79, *α* = .6 - .7), $\blacksquare$ = good, (ICC = .75 -.9, *r* = .6 - .8, *κ* = .8 - .9, *α* = .7 - .9) $\blacksquare$ = excellent validity/reliability (ICC \>.9, *r* \> 8, *κ* \>.9, *α* \> .9)

Sixteen studies evaluated the structure of the items within various editions of the TGMD, consistently finding a two factor model (locomotion and object control) for the TGMD \[[@pone.0237919.ref152]\], TGMD-2 \[[@pone.0237919.ref059], [@pone.0237919.ref063], [@pone.0237919.ref068], [@pone.0237919.ref077], [@pone.0237919.ref082], [@pone.0237919.ref142], [@pone.0237919.ref143], [@pone.0237919.ref146], [@pone.0237919.ref147]\], TGMD-2 SF \[[@pone.0237919.ref084]\] and TGMD-3 \[[@pone.0237919.ref085], [@pone.0237919.ref144], [@pone.0237919.ref145], [@pone.0237919.ref149], [@pone.0237919.ref151]\], as predicted by multiple studies \[[@pone.0237919.ref059], [@pone.0237919.ref146], [@pone.0237919.ref149], [@pone.0237919.ref152]\].  It is, however, important to note that some of these models enabled cross-loading of items \[e.g.  147\], some models were hierarchical in nature \[[@pone.0237919.ref077]\] and in one case a two factor model, whilst best fit, explained only 50% of the total variance \[[@pone.0237919.ref142]\].  Evidence was however found to suggest that the structural validity of the TGMD is stable across countries, with the data from populations in Greece, Brazil, Germany, the USA, South Korea and Portugal all evidencing a two factor model \[[@pone.0237919.ref067], [@pone.0237919.ref082], [@pone.0237919.ref143], [@pone.0237919.ref144], [@pone.0237919.ref146], [@pone.0237919.ref152]\]. 

The content validity of the Brazilian translation of the TGMD-2 and TGMD-3 was evaluated by two studies, with stronger evidence for the validity of the TGMD-2 (CVI = .93 for clarity and .91 for pertinence) than the TGMD-3 for which the CVI for the clarity of the instructions only reached .78 \[[@pone.0237919.ref082], [@pone.0237919.ref085]\].  The Spanish translation of the TGMD-2 was also tested for clarity and pertinence, with results finding a CVI of .83 \[[@pone.0237919.ref141]\].  Cross cultural validity was investigated in one study that compared Flemish children with intellectual deficits to US normative data \[[@pone.0237919.ref063]\], which found significant differences, with large effect sizes (1.22--1.57), indicating US standardised data was inappropriate for use as a comparison within this population.  Additionally, a large study based in Belgium hypothesised that Belgian children would perform similarly to US norms on locomotor scores, but that Belgian children would score lower on object control tasks, however, Belgian children had significantly worse GMQ, locomotor and object control scores, thus showing that US normative data was not appropriate for this sample \[[@pone.0237919.ref153]\].  The COSMIN quality rating of TGMD studies did not appear to effect results, as the relative quality ratings of all studies that found excellent results only varied by 16% \[[@pone.0237919.ref056], [@pone.0237919.ref059], [@pone.0237919.ref061], [@pone.0237919.ref063], [@pone.0237919.ref068], [@pone.0237919.ref072], [@pone.0237919.ref082], [@pone.0237919.ref084], [@pone.0237919.ref085], [@pone.0237919.ref144]\] (54--70%).  However, predictive validity was not explored by the included TGMD studies. 

### Other process-oriented assessment tools {#sec024}

The psychometric properties of the FG-Compass \[[@pone.0237919.ref102]\] were evaluated in one study, in which expert scores were compared to undergraduate student scores \[[@pone.0237919.ref154]\].  Results showed kappa values ranging from .51-.89, with moderate levels of agreement on average (*m* = .71).  PLAYbasic was found to have good inter-rater reliability (mean ICC = .86), and moderate internal consistency (mean α = .605) in one study \[[@pone.0237919.ref044]\].  Two studies evaluated PLAYfun, finding good to excellent inter-rater reliability (ICC ranged from .78 - .98) and good internal consistency (average *α* = .78) \[[@pone.0237919.ref044], [@pone.0237919.ref091]\].  Additionally, hypotheses testing validity and structural validity were assessed, with performance increasing with age as hypothesised, and an acceptable model fit for the proposed five factor structure \[[@pone.0237919.ref091]\].  Despite the quality ratings of these studies varying, (43% and 76%), the higher quality study found the more promising results \[[@pone.0237919.ref091]\].  One study evaluated the psychometric properties of the Teen Risk Screen \[[@pone.0237919.ref048]\], with results demonstrating good evidence for the internal consistency (mean α = .75) and test-retest reliability (mean *r* = .64) of subscales.  Confirmatory factor analysis (CFA) was used to evaluate the structural validity of the Teen Risk Screen, however, the analysis was not completed on the model they proposed (6 subscales).  Authors claimed that due to small sample sizes, only three of the six subscales were evaluated separately, and the final three were grouped together.  As this analysis did not measure the intended model, results are not detailed in this review.  Get Skilled Get Active (GSGA), the Peabody Developmental Motor Scales (PDMS-2) and the Victorian FMS assessment were all used in concurrent validity studies, however, no articles were found evaluating any other aspects of validity and reliability of these measures. 

Combined assessments {#sec025}
--------------------

Two assessment tools from the pre-search measure both product- and process-orientated aspects of movement: Canadian Agility and Movement Skill Assessment (CAMSA) \[[@pone.0237919.ref092]\] and PE Metrics \[[@pone.0237919.ref113], [@pone.0237919.ref114]\].  There is limited evidence for the reliability of the CAMSA with one study finding moderate effect sizes for inter-rater, intra-rater and test-retest reliability, as well as internal consistency \[[@pone.0237919.ref092]\].  One other study found strong evidence for the test-retest reliability of the CAMSA \[[@pone.0237919.ref074]\], however that study had a lower quality rating (49% compared to 77%).  One study evaluated the structural validity of PE Metrics using Rasch analysis and found good evidence that all of the items were measuring the same overarching set of motor skills \[[@pone.0237919.ref155]\].  It is, however, necessary to interpret this result with caution, as the COSMIN quality rating for this study was only 43%. 

Concurrent validity {#sec026}
-------------------

Limited evidence was found for concurrent validity across the 23 assessment tools included in the review (see [Table 7](#pone.0237919.t007){ref-type="table"}).  A large proportion of the studies exploring this aspect of validity did so against either the MABC (15 studies) or the TGMD (10 studies). 

10.1371/journal.pone.0237919.t007

###### Concurrent validity of assessment tools. 

![]( pone.0237919.t007){#pone.0237919.t007g}

                     Product-Oriented   Process-Oriented                                                              
  ------------------ ------------------ ------------------ ------- ------- ------- ------- ------- ------- ------- -- -------
  Product-Oriented   AST                                                                                              
  BOT                                   **1**              **1**                                                      
  KTK                **1**              **1**              **1**   **1**                                              
  MOT 4--6                                                 **1**                                                      
  MABC                                  **1**              **1**   **3**   **1**                                      
  FMS Polygon                                                                                                         
  Process-Oriented   GSGA                                                                                             
  PDMS                                                                     **1**                                      
  TGMD                                                     **1**           **2**   **2**   **1**   **1**   **1**      **2**

*NB*: $\blacksquare$ = poor (ICC \< .5, *r* \< .3, *κ* \< .6, *α* \< .6), $\blacksquare$ = moderate (ICC = .5 -.75, *r* = .3 - .6, *κ* = .6 - .79, *α* = .6 - .7), $\blacksquare$ = good, (ICC = .75 -.9, *r* = .6 - .8, *κ* = .8 - .9, *α* = .7 - .9) $\blacksquare$ = excellent validity/reliability (ICC \>.9, *r* \> 8, *κ* \>.9, *α* \> .9)

### Between product-oriented {#sec027}

The findings of studies exploring the concurrent validity of product-oriented assessment tools mostly yielded good results, with only three out of thirteen studies finding less than good evidence for correlations between measures.  Of these three studies, one found a poor correlation (kappa = .43) between the MABC and the BOT \[[@pone.0237919.ref060]\], and two studies found moderate correlations between the MABC and the short form of the BOT \[[@pone.0237919.ref093]\], as well the AST and the KTK, as hypothesised \[[@pone.0237919.ref137]\].  Two studies evaluated the concurrent validity of the BOT-2 complete form, and the BOT-2 short form \[[@pone.0237919.ref062], [@pone.0237919.ref156]\].  One found poor correlations between subtests (*r* ranged from .08 - .45) \[[@pone.0237919.ref156]\], and the other reported moderate correlations between tasks in a sample of children with ADHD (*r* ranged from .12 - .98) \[[@pone.0237919.ref062]\].  A modified version of the KTK (with hopping for height removed) was also compared to the standard KTK, which was found to have high levels of validity \[[@pone.0237919.ref089]\].  One study used Pearson correlations to evaluate the concurrent validity between the MOT 4--6 and the KTK, with results showing moderate correlations for children aged 5--6 (mean *r* = .63), as was hypothesised prior to testing (*r* \>.6).  In addition to the results detailed in [Table 6](#pone.0237919.t006){ref-type="table"}, one study looked at the concurrent validity of assessing children using the MABC in person and via tele-rehabilitation software, with results showing no significant difference between scores, as hypothesised \[[@pone.0237919.ref076]\].  As well as this, the MABC and the BOT-SF had a positive predictive value of .88, with twenty one out of twenty four children testing positively for motor coordination problems also scoring below the fifteenth percentile on the MABC \[[@pone.0237919.ref090]\]. 

### Between process-oriented {#sec028}

One study utilised the TGMD to explore the concurrent validity of the GSGA assessment tool \[[@pone.0237919.ref097]\].  Significant differences were found between the number of children who were classified as mastering FMS versus those who had not, in which GSGA was more sensitive and classified a greater number of children as exhibiting non-mastery \[[@pone.0237919.ref097]\].  Three studies also explored the relationship between multiple versions of the TGMD.  Results revealed that children with ASD perform better on the TGMD-3 with visual aids compared to the standard assessments \[[@pone.0237919.ref056]\].  Similarly, modified versions of the TGMD-2 and TGMD-3 were both found to be valid for use in children with visual deficits \[[@pone.0237919.ref067]\].  Additionally, one study showed significant differences between subtest scores on the second and third editions of the TGMD across year groups and gender, in which participants performed better on the TGMD-2 \[[@pone.0237919.ref069]\]. 

### Between product- and process-orientated {#sec029}

The results comparing process and product-oriented assessment tools against each other were also mixed, particularly with regards to the concurrent validity between the MABC and the TGMD, for which correlations ranged from .27-.65 \[[@pone.0237919.ref053], [@pone.0237919.ref068], [@pone.0237919.ref082], [@pone.0237919.ref083], [@pone.0237919.ref157]\].  Study quality did not appear to have an effect on the size of the correlation between the MABC and the TGMD.  Two studies also reported significant differences in level of agreement on percentile ranks \[[@pone.0237919.ref053], [@pone.0237919.ref157]\].  The KTK and the TGMD-2 also differed significantly in terms of their classifications of children into percentile ranks \[[@pone.0237919.ref070]\].  The concurrent validity of the CAMSA and both the PLAYbasic and PLAYfun assessment tools were assessed by one study, which found moderate correlations between CAMSA and both PLAY assessment tools, smaller than was hypothesised \[[@pone.0237919.ref044]\].  Lastly, good cross-product/process concurrent validity was reported between the MABC and the PDMS \[[@pone.0237919.ref122]\], as well as the CAMSA and the Victorian FMS Assessment Tool \[[@pone.0237919.ref074]\] and the TGMD and the FMS Polygon, as hypothesised \[[@pone.0237919.ref138]\]. 

Discussion {#sec030}
==========

The aim of the review was to evaluate the psychometric properties of observational FMS assessment tools for school-age children.  There were no studies evaluating the validity or reliability of eight (33%) of the available measures (from 24 identified tools).  Of the remaining sixteen, nine (38%) assessment tools only had a single study examining their psychometric properties.  Multiple papers evaluating various aspects of validity and reliability were only found for the: MABC (37studies), TGMD (35 studies), BOT (22 studies), KTK (10 studies), CAMSA (3 studies), the MOT 4--6 (4 studies) and PLAYfun (2 studies). 

The TGMD was the assessment tool with the most consistently positive evidence in favour of validity and reliability.  However, it is important to consider the suitability of observational assessment tools for use in schools, alongside the evidence for the psychometric properties of measures \[[@pone.0237919.ref158]\].  Recent research by Klingberg et al.  established a framework to evaluate the feasibility of implementing FMS assessments in schools \[[@pone.0237919.ref022]\].  One of the criteria for feasibility detailed in the report was the type of assessment, in which it was stated that product-oriented measures were preferable because they require less training, and are less prone to error.  So despite the TGMD being the assessment tool with the greatest evidence for validity and reliability, it is arguably less feasible to implement in schools settings because it is process-orientated \[[@pone.0237919.ref022]\].  Notably, despite the strong evidence for the psychometric properties of the TGMD, this assessment tool does not measure balance.  Recent research has established that balance is an important aspect of FMS \[[@pone.0237919.ref024]\] so it is important to recognise the limitations of using tools which do not measure such skills.  It seems reasonable to suggest that exploration of the FMS proficiency of children in schools should involve an assessment tool which encompasses locomotor skill, object control and balance to enable insights into the skills which underpin a child's ability to participate in physical activity \[[@pone.0237919.ref005]\]. 

The systematic review found nine product-oriented assessment tools.  The product-oriented measure with the most promising feasibility in Klingberg et al. 's review \[[@pone.0237919.ref022]\], which was also included in this review, was the AST \[[@pone.0237919.ref098]\].  There is, however, insufficient evidence on the psychometric properties of this assessment tool to allow confidence in its use, as only two of the ten forms of validity and reliability specified by the COSMIN checklist \[[@pone.0237919.ref025]\] were evaluated in the studies we reviewed \[[@pone.0237919.ref098], [@pone.0237919.ref137]\].  Moreover, the AST assesses how quickly a child can perform a range of FMS, rather than how well each child can perform these movements, arguably limiting the value of the results obtained by the assessment because it focuses solely on speed of movement.  Additionally, this assessment, again, does not include a measure of balance.  Thus, it would also not provide a school with a comprehensive picture of pupils' FMS. 

Only three of the product-oriented assessment tools in this review measure locomotion, object control and balance.  The measure with the largest number of psychometric properties evaluated from these three tools was the MABC.  However, the evidence for the validity and reliability of this assessment tool was very mixed, and the quality of the studies that found strong evidence for its psychometric properties was questionable.  Moreover, the MABC requires specialist equipment such as mats, which contribute to making the measure expensive to buy (approximately £1000).  This may not be feasible with increasing pressure on school budgets \[[@pone.0237919.ref159]\].  The MABC also takes an extended period of time to administer (30--60 minutes), and must be delivered 1-to-1 by a trained professional.  These time and resource constraints makes it difficult to recommend to schools as a feasible screening measure, despite it being advocated as the current 'gold standard' for detecting motor skill deficits in Europe \[[@pone.0237919.ref160]\]. 

The BOT was the next most explored product-oriented assessment tool that measures all three aspects of FMS, and whilst it was not considered in the Klingberg et al.  evaluation of the feasibility of assessments \[[@pone.0237919.ref022]\] it is again, notably costly to purchase and takes between 45--60 minutes to assess each child.  Thus, with teachers feeling increasingly concerned about the time they have available to cover the 'core' assessed curriculum \[[@pone.0237919.ref161]\], it appears unlikely that schools would be willing to invest the time required to universally assess FMS all pupils using this tool.  The final product-oriented assessment tool which assesses all three aspects of FMS is 'Stay in Step' \[[@pone.0237919.ref047]\].  There were, however, no studies found that evaluate the psychometric properties of this assessment tool.  This is particularly problematic as it is already being used within schools in Australia.  It is crucial that assessment tools are developed using a rigorous process which ensures they have strong psychometric properties.  Schools have limited capacity for new initiatives, so it is important that assessment tools being marketed to them are not only feasible for use, but can also accurately measure FMS and identify children that need additional support, otherwise the assessment becomes redundant, and a waste of already stretched resources.  In summary, this review offers a guide to help researchers, clinicians and teachers make an informed decision on available observational FMS assessment tools.  However, as discussed, there are a number of limitations with regard to all available assessments which need to be considered.  There is an appetite amongst health practitioners to use schools as settings for motor skill assessments \[[@pone.0237919.ref019]\] but currently available measures have limited utility within such environments.  The majority of existing assessments are commercial products creating significant financial implications for schools that wish to deploy these tests at scale.  Moreover, a lot of these tests require a substantial investment of time as they are designed to be conducted with a single child, with children tested in a serial manner.  Meanwhile, the tests that do exist without some of these limitations (e.g. AST and KTK) have limited evidence for their validity and reliability, and/or do not measure all three aspects of FMS \[[@pone.0237919.ref024]\], which limits the justification of their use within evidence-based health and educational practice.  Either, assessment tools with strong evidence for validity and reliability (e.g. TGMD) need to be modified to be feasible for use in schools, or feasible tests (e.g. AST) need more research to be done to establish psychometric properties.  Currently, schools would have to choose an assessment tool based on either feasibility or strong psychometric evidence alone, however, it is known from educational research that there needs to be a trade-off between the two for school-based initiatives to be implemented consistently, and effective \[[@pone.0237919.ref158]\]. 

This review reveals that there are a large number of novel observational assessment tools that have been and are continuing to be developed to measure FMS proficiency in school-age children.  We would argue that authors must consider from the outset how to make such tools feasible for use in schools.  The results also showed that not enough FMS assessment tools being developed include all three aspects of FMS.  In particular, balance has been neglected despite research establishing it as a crucial addition to this group of motor skills \[[@pone.0237919.ref024]\].  In addition, it is important that the evaluation of the psychometric properties of these new tools is comprehensive, spanning all psychometric properties outlined by the COSMIN guidelines \[[@pone.0237919.ref025]\].  One of the main limitations of the studies included in this review was the tendency for the authors to be selective about which aspects of validity and reliability were tested.  All aspects of validity/ reliability in the COSMIN guidelines evaluated by this review were measured by at least one study, however, no single aspect was measured than more by half of the studies.  The most commonly measured aspects of validity and reliability were inter-rater reliability (45% of studies) and structural validity (42% of studies).  Future research should consider evaluating predictive validity (1% of studies) and cross-cultural validity (7% of studies) using normative data more often, as these were the most neglected psychometric properties.  The lack of consistency for measuring psychometric properties makes it difficult to draw any conclusions about the quality of the tools advertised, particularly when the reports involve the testing of specially selected samples (e.g. children with ASD) where there are fewer studies undertaken. 

Conclusion {#sec031}
==========

It is clear from the published literature there is insufficient evidence to justify the use of current FMS assessment tools for screening in schools.  It follows that: (i) researchers, teachers, and clinicians should be cautious when selecting existing measures of FMS for use in these settings; (ii) there is a need to develop low cost, reliable and valid measures of FMS that are suitable for testing large numbers of children within school settings. 

Supporting information {#sec032}
======================

###### PRISMA 2009 checklist. 

(DOC)

###### 

Click here for additional data file. 

###### Search strategy. 

(DOCX)

###### 

Click here for additional data file. 

###### Study table. 

(DOCX)

###### 

Click here for additional data file. 

10.1371/journal.pone.0237919.r001

Decision Letter 0

Montazeri

Ali

Academic Editor

© 2020 Ali Montazeri

2020

Ali Montazeri

This is an open access article distributed under the terms of the

Creative Commons Attribution License

, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. 

18 May 2020

PONE-D-20-03384

The validity and reliability of observational assessment tools available to measure fundamental movement skills in school-age children: a systematic review. 

PLOS ONE

Dear Dr. Eddy

Thank you for submitting your manuscript to PLOS ONE.  After careful consideration, we feel that it has merit but does not fully meet PLOS ONE's publication criteria as it currently stands.  Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. 

We would appreciate receiving your revised manuscript by Jul 02 2020 11:59PM.  When you are ready to submit your revision, log on to <https://www.editorialmanager.com/pone/> and select the \'Submissions Needing Revision\' folder to locate your manuscript file. 

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. 

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future.  For instructions see: <http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols>

Please include the following items when submitting your revised manuscript:

A rebuttal letter that responds to each point raised by the academic editor and reviewer(s).  This letter should be uploaded as separate file and labeled \'Response to Reviewers\'. A marked-up copy of your manuscript that highlights changes made to the original version.  This file should be uploaded as separate file and labeled \'Revised Manuscript with Track Changes\'. An unmarked version of your revised paper without tracked changes.  This file should be uploaded as separate file and labeled \'Manuscript\'. 

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available.  The record will include editor decision letters (with reviews) and your responses to reviewer comments.  If eligible, we will contact you to opt in or out. 

We look forward to receiving your revised manuscript. 

Kind regards,

Ali Montazeri

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements. 

1\. Please ensure that your manuscript meets PLOS ONE\'s style requirements, including those for file naming.  The PLOS ONE style templates can be found at

<https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf> and

<https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf>

2\. We noticed that the search of your systematic review was last performed in January 2019.  Please ensure that the search is up to date and that your systematic review includes any new studies published since then

\[Note: HTML markup is below.  Please do not edit.\]

Reviewers\' comments:

Reviewer\'s Responses to Questions

**Comments to the Author**

1\. Is the manuscript technically sound, and do the data support the conclusions? 

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions.  Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes.  The conclusions must be drawn appropriately based on the data presented. 

Reviewer \#1: Yes

Reviewer \#2: Partly

\*\*\*\*\*\*\*\*\*\*

2\. Has the statistical analysis been performed appropriately and rigorously? 

Reviewer \#1: Yes

Reviewer \#2: N/A

\*\*\*\*\*\*\*\*\*\*

3\. Have the authors made all data underlying the findings in their manuscript fully available? 

The [PLOS Data policy](http://www.plosone.org/static/policies.action#sharing) requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file).  The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository.  For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available.  If there are restrictions on publicly sharing data---e.g. participant privacy or use of data from a third party---those must be specified. 

Reviewer \#1: Yes

Reviewer \#2: No

\*\*\*\*\*\*\*\*\*\*

4\. Is the manuscript presented in an intelligible fashion and written in standard English? 

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous.  Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. 

Reviewer \#1: Yes

Reviewer \#2: Yes

\*\*\*\*\*\*\*\*\*\*

5\. Review Comments to the Author

Please use the space provided to explain your answers to the questions above.  You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. ( Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer \#1: This systematic review aggregated findings from 75 studies that evaluated the validity and reliability of FMS assessment tools for school-aged children.  In general, the paper is well-written, informative, and it provides important information on the validity and reliability of FMS assessments.  However, the introduction and the methods need clarification because they are too short: for the reader it is hard to follow the sections.  The results and the discussion are good. 

Abstract:

\- explain the abbreviations (TGMD, MABC etc.) 

\- hard to follow the result section

Introduction:

\- too short; needs more details especially in the first section; explain studies in more detail

\- the arguementation is not clear

Methods:

\- obscure, hard to follow because information on the methods and the results are mixed up

\- describe the pre-search step by step

\- where are the inclusion and exclusion criteria and their justification? 

\- why did you not followed a modified PICOS approach? 

Results:

\- why did you considered children with disorders?  needs to be justified in the methods

\- table 2 & 3.4 should be a part of the methods

\- list the values of the validity and reliability in tables 4-7

Reviewer \#2: This article focuses on a very important topic and is of acceptable quality.  But to improve the article, there are the following suggestions:

1- What is the main problem of the research statement?  Why are researchers focused on observational tools?  This is not in the introduction. 

2- Search terms are very limited.  There are many articles or tools that do not have the term \"fundamental or skills\" in their titles.  This strategy may limit the number of attained articles. 

3- Quality evaluation of selective researches is required.  This index can show the quality of any research and illustrate the accuracy and dependability of findings.  There are many ways and means to evaluate the quality of research. 

4- Data extraction criteria have been taken arbitrarily.  Using the standard method for evaluation and review can be understandable and useful.  The Consensus-Based Standards for the Selection of Health Status Measurement Instruments (COSMIN) is an internationally accepted manner to measurements assessment.  Thus this is suggested that the results section of the article arrange according to the COSMIN checklist.  This can easily and clearly illustrate the pros and cons of each measurement.  This matter also can show the pitfalls and disadvantages of tools collectively.  It is not only beneficial in the selection of instruments for clinical practice but also shows issues that are necessary to be considered in new studies for revising and development of new measures. 

5- The vast amount of discussion - especially in the beginning - is the paragraph of the result.  Results ought to be discussed, not to repeat. 

6- Fortunately, in the final sections of the discussion, the authors return to the discussion, and from a broad perspective, they talk about the shortcomings and opportunities of the tools and offer useful and consciousness-raising advice to clinicians and researchers.  I believe that this approach should be the dominant frame of discussion and that authors should integrate the findings with theoretical literature, and finally guide clinics, schools, and institutions to gain insight into the problems in this area. 

Kind Regards

\*\*\*\*\*\*\*\*\*\*

6\. PLOS authors have the option to publish the peer review history of their article ([what does this mean?](https://journals.plos.org/plosone/s/editorial-and-peer-review-process#loc-peer-review-history)).  If published, this will include your full peer review and any attached files. 

If you choose "no", your identity will remain anonymous but your review may still be made public. 

**Do you want your identity to be public for this peer review?**  For information about this choice, including consent withdrawal, please see our [Privacy Policy](https://www.plos.org/privacy-policy). 

Reviewer \#1: No

Reviewer \#2: Yes: Saeed Akbari-Zardkhaneh

\[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site.  Please log into your account, locate the manuscript record, and check for the action link \"View Attachments\".  If this link does not appear, there are no attachment files to be viewed.\]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, <https://pacev2.apexcovantage.com/>.  PACE helps ensure that figures meet PLOS requirements.  To use PACE, you must first register as a user.  Registration is free.  Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool.  If you encounter any issues or have any questions when using PACE, please email us at <figures@plos.org>.  Please note that Supporting Information files do not need this step. 

###### 

Submitted filename: POLOS.docx

###### 

Click here for additional data file. 

10.1371/journal.pone.0237919.r002

Author response to Decision Letter 0

8 Jul 2020

Dear Dr Montazeri

PONE-D-20-03384: "The validity and reliability of observational assessment tools available to measure fundamental movement skills in school-age children: a systematic review". 

I would like to begin by thanking yourself and the reviewers for the extremely useful comments on the first submission of our manuscript.  We are grateful for being given the opportunity to submit a revised version. 

We have addressed each of the points raised by the reviewers and feel the changes enhance the novel contribution of this review.  All edits have been made using tracked changes. 

We have addressed each comment in turn below -- the page references refer to the document in 'simple markup' format, unless otherwise stated. 

Thank you again for your help with this submission, and we hope that this revised version is suitable for publication in PLOS One. 

Yours sincerely,

Lucy Eddy

(On behalf of all co-authors)

Journal Requirements:

• Please ensure that your manuscript meets PLOS ONE\'s style requirements, including those for file naming. 

Authors' comment: The manuscript has been updated to ensure it meets PLOS ONE style requirements. 

• We noticed that the search of your systematic review was last performed in January 2019.  Please ensure that the search is up to date and that your systematic review includes any new studies published since then

Authors' comment: We thank you for the opportunity to include newly published studies.  Both the pre-search, and the full search were updated on 19th May 2020.  One additional assessment tool, and fifteen additional articles have been added as a result. 

Reviewer \#1 Comments

1\. This systematic review aggregated findings from 75 studies that evaluated the validity and reliability of FMS assessment tools for school-aged children.  In general, the paper is well-written, informative, and it provides important information on the validity and reliability of FMS assessments.  However, the introduction and the methods need clarification because they are too short: for the reader it is hard to follow the sections.  The results and the discussion are good. 

Authors' comment: We thank the reviewer for their positive comments and have sought to address the concerns about the brevity of some sections (see response to comments 5 through 11). 

Abstract:

2\. Explain the abbreviations (TGMD, MABC etc. 

Authors' comment: The abbreviations have been described in the abstract (page 2). 

3\. hard to follow the result section

Authors' comment: This is a very valuable comment.  The results of the abstract have been changed to minimise the number of assessment tools described, in the hope that this will make the results section more clear.  Instead, the abstract now describes in more detail the results of the three assessment tools with the most psychometric properties measured.  There is also a more general statement about the remaining assessment tools and the feasibility of using current assessments in schools (page 2). 

Introduction:

4\. too short; needs more details especially in the first section; explain studies in more detail

Authors' comment: The relationship between fundamental movement skills and other aspects of childhood development have now been clarified in the introduction (page 3, paragraph 1). 

5\. the arguementation is not clear

Authors' comment: We agree that the introduction did not make a clear enough argument.  The order and flow of the introduction have been edited to explain: i) why FMS are important, ii) issues with identifying children through current healthcare systems, iii) potential benefits of moving assessments into schools and iv) that there are a large number of assessment tools available for use, which makes it difficult for schools to know which is most suitable (pages 3 &4). 

Methods:

6\. obscure, hard to follow because information on the methods and the results are mixed up

7\. describe the pre-search step by step

Authors' comment: The pre-search now has a full explanation of the search process (page 5, paragraph 1) and the results of the pre-search now feature at the start of the results section (pages 8 & 9, 'assessment tools').  We would like to thank the reviewer for these observations, which we believe has improved the methods and results sections, making them more clear and distinct. 

8\. where are the inclusion and exclusion criteria and their justification? 

9\. why did you considered children with disorders?  Needs to be justified in the methods

Authors' comment: The inclusion criteria have now been clarified and expanded.  This includes a justification of why studies that sampled children with disorders were included (pages 5 - Inclusion Criteria and Preliminary Systematic Search). 

10\. why did you not followed a modified PICOS approach? 

Authors' comment: A PICOS approach was not thought to be appropriate for this review because it was not a systematic review of a healthcare interventions.  It didn't look to review experimental Studies of a specific design that evaluated differences between an Intervention or Control and thus only two of the five sections (Population and Outcome) would have been relevant.  Instead, we did a pre-search on existing assessment tools, to generate a comprehensive set of search terms defining our Outcome.  The search terms we used for age could be thought of as defining our Population.  We also utilised a combination of search terms from other validity and reliability systematic reviews to ensure all relevant results were found. 

Results:

11\. table 2 & 3 should be a part of the methods

Authors' Comment: Table 2 has been moved to the methods (and is now Table 1 on page 7).  Now that the results of the pre-search have been moved to the results section (see response to comment 8), we feel that table 3 should remain in the results section, as it details the number of studies found on the validity and reliability of each assessment tool, as well as the psychometric properties assessed by included studies (pages 12-20). 

12\. list the values of the validity and reliability in tables 4-7

Authors' Comment: We have taken into consideration the reviewer comments about putting statistics into tables 4-7, however, due to the large variation of statistical techniques used, and psychometric properties measured, we feel this information is better placed in the supplementary material 2 to avoid a 'cluttered' table that is difficult to decipher.  Additionally, for many of the studies in these tables, there wasn't a singular metric as many included statistics for individual tasks, or subtests.  The colours in these tables represent the mean value of all FMS tasks/ subtests in a given paper.  This has been clarified in the methods section (page 8 paragraph 1).  The values for each classification (poor --excellent) for type of statistical test have also been included as a footnote for each table, for ease of interpretation (tables 4-7).  The full breakdown of validity and reliability values is available in supplementary material 2, and this is more clearly explained in the methods section. 

Reviewer \#2 comments:

13\. This article focuses on a very important topic and is of acceptable quality

Authors' comment: We thank the reviewer for recognising the need for a systematic review on this subject area. 

14\. What is the main problem of the research statement?  Why are researchers focused on observational tools?  This is not in the introduction. 

Authors' comment: We agree that the introduction did not make it clear enough why the focus was on observational assessment tools.  This has now been expanded, based on research which suggests that these assessments may be the most feasible for use in schools.  This also helps to articulate the main aim of our research, to help discern which of these observational assessments might be viable for use as in-school screening tools, due to having sufficient validity, reliability and feasibility (final paragraph on page 3, continuing onto page 4). 

15\. Search terms are very limited.  There are many articles or tools that do not have the term \"fundamental or skills\" in their titles.  This strategy may limit the number of attained articles. 

Authors' comment: The search terms for the pre-search were intentionally limited.  We only wanted to assess the validity and/or reliability of assessment tools that have been used in peer-reviewed research to assess fundamental movement skills (also known as fundamental motor skills).  There are a larger number of assessment tools available to measure motor competence more generally, however, this review focused on FMS specifically.  Our aim was to evaluate tools that clearly self-identify specifically as measures of FMS, and thus presumably market themselves to schools as such. 

16\. Quality evaluation of selective researches is required.  This index can show the quality of any research and illustrate the accuracy and dependability of findings.  There are many ways and means to evaluate the quality of research. 

Data extraction criteria have been taken arbitrarily.  Using the standard method for evaluation and review can be understandable and useful.  The Consensus-Based Standards for the Selection of Health Status Measurement Instruments (COSMIN) is an internationally accepted manner to measurements assessment.  Thus this is suggested that the results section of the article arrange according to the COSMIN checklist.  This can easily and clearly illustrate the pros and cons of each measurement.  This matter also can show the pitfalls and disadvantages of tools collectively.  It is not only beneficial in the selection of instruments for clinical practice but also shows issues that are necessary to be considered in new studies for revising and development of new measures. 

Authors' comment: We would like to thank the reviewer for suggesting that we use the COSMIN checklists to evaluate study quality, and we think that this addition has significantly improved the manuscript.  We have removed the Risk of Bias (ROBANS tool) from the manuscript, and all studies were evaluated using the more fitting COSMIN guidelines instead.  The methodology for using this quality assessment can be found within 'Data Extraction Process & Quality Assessment' on page 6.  A general paragraph on the quality of included studies has been included on page 10 (COSMIN Quality Assessment), and an evaluation of how study quality impacted upon the results of studies can be found within each results section (pages 21-32).  The results of the quality assessment for individual studies can also be found in Supporting information 2 -- study table (methodological quality column). 

17\. The vast amount of discussion - especially in the beginning - is the paragraph of the result.  Results ought to be discussed, not to repeat. 

Authors' comment: We agree that the start of the discussion was repetitive of the results (see the final paragraph on page 33 of the 'all markup' version of the manuscript).  We have edited the discussion, so the introductory paragraph is a brief overview of results, before discussing the results in conjunction with relevant literature. 

18\. Fortunately, in the final sections of the discussion, the authors return to the discussion, and from a broad perspective, they talk about the shortcomings and opportunities of the tools and offer useful and consciousness-raising advice to clinicians and researchers.  I believe that this approach should be the dominant frame of discussion and that authors should integrate the findings with theoretical literature, and finally guide clinics, schools, and institutions to gain insight into the problems in this area. 

Authors' comment: This was a very valuable comment.  The discussion has now been modified so that this is the main focus.  We have restructured the discussion to make the argument clearer.  The discussion now explains i) from the systematic review, which assessment tool was the most valid and reliable, and how suitable this assessment tool is for use within schools, based on feasibility criteria, ii) the type of assessment tool most feasible for use in schools, and justification as to why, iii) the psychometric properties of assessment tools which fell within this group (pages 32-35). 

###### 

Submitted filename: Response to Reviewers.docx

###### 

Click here for additional data file. 

10.1371/journal.pone.0237919.r003

Decision Letter 1

Montazeri

Ali

Academic Editor

© 2020 Ali Montazeri

2020

Ali Montazeri

This is an open access article distributed under the terms of the

Creative Commons Attribution License

, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. 

6 Aug 2020

The validity and reliability of observational assessment tools available to measure fundamental movement skills in school-age children: a systematic review. 

PONE-D-20-03384R1

Dear Dr. Eddy,

We're pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. 

Within one week, you'll receive an e-mail detailing the required amendments.  When these have been addressed, you'll receive a formal acceptance letter and your manuscript will be scheduled for publication. 

An invoice for payment will follow shortly after the formal acceptance.  To ensure an efficient process, please log into Editorial Manager at <http://www.editorialmanager.com/pone/>, click the \'Update My Information\' link at the top of the page, and double check that your user information is up-to-date.  If you have any billing related questions, please contact our Author Billing department directly at <authorbilling@plos.org>. 

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact.  If they'll be preparing press materials, please inform our press team as soon as possible \-- no later than 48 hours after receiving the formal acceptance.  Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication.  For more information, please contact <onepress@plos.org>. 

Kind regards,

Ali Montazeri

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers\' comments:

10.1371/journal.pone.0237919.r004

Acceptance letter

Montazeri

Ali

Academic Editor

© 2020 Ali Montazeri

2020

Ali Montazeri

This is an open access article distributed under the terms of the

Creative Commons Attribution License

, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. 

12 Aug 2020

PONE-D-20-03384R1

The validity and reliability of observational assessment tools available to measure fundamental movement skills in school-age children: a systematic review. 

Dear Dr. Eddy:

I\'m pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE.  Congratulations!  Your manuscript is now with our production department. 

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact.  If they\'ll be preparing press materials, please inform our press team within the next 48 hours.  Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication.  For more information please contact <onepress@plos.org>. 

If we can help with anything else, please email us at <plosone@plos.org>. 

Thank you for submitting your work to PLOS ONE and supporting open access. 

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Professor Ali Montazeri

Academic Editor

PLOS ONE

[^1]: **Competing Interests:**The authors have declared that no competing interests exist. 

[^2]: ‡ These authors also contributed equally to this work.