# Development and Reliability of a Street Skateboarding Notational Analysis Framework and Application
## 3 Results
### Reliability
#### 3.2.2 Inter-Rater Reliability  
Frame selection inter-rater reliability for all groups had a MAD 95% upper limit greater than the 3-frame threshold. Only Frame\({}_{\text{LD}}\) was acceptable, and was the most consistent across all rater combinations; however, this was not the case when involving quarterpipes (MAD Upper CI \(<\) 2 frames) (Table 9). Additionally, of all the groups, Frame\({}_{\text{IA-Start}}\) onto a ledge, and Frame\({}_{\text{IA-End}}\) off stairs or rails, and out of slides (MAD Upper CI \(<\) 3.1 frames) \begin{table}
\begin{tabular}{c c c c c c} \hline \hline  & \multirow{2}{*}{**Grouping**} & & \multicolumn{3}{c}{**MAD [95\% CI] a**} \\  & & & \multicolumn{2}{c}{**(\(n\) = \# TAs) b**} & \\ \cline{3-6}  & & & **Frame\({}_{\text{TO}}\)** & **Frame\({}_{\text{IA-Start}}\)** & **Frame\({}_{\text{IA-End}}\)** & **Frame\({}_{\text{LD}}\)** \\ \hline \multirow{6}{*}{**Ours**} & \multirow{2}{*}{Male} & 1.67 [1.48, 1.85] & 2.42 [2.16, 2.65] & 2 [1.75, 2.28] & 1.43 [1.27, 1.61] \\  & & & (\(n\) = 322) & (\(n\) = 322) & (\(n\) = 322) \\  & & Female & 1.12 [0.95, 1.33] & 2.06 [1.79, 2.36] & 2.08 [1.81, 2.38] & 1.21 [1.02, 1.43] \\  & & & (\(n\) = 264) & (\(n\) = 264) & (\(n\) = 264) \\ \hline \multirow{6}{*}{**Ours**} & \multirow{2}{*}{Grind} & 1.4 [1.13, 1.7] & 2.44 [2.1, 2.8] & 2.38 [1.99, 2.8] & 1.16 [0.93, 1.39] \\  & & & (\(n\) = 174) & (\(n\) = 174) & (\(n\) = 174) & (\(n\) = 174) \\  & & Slide & 0.97 [0.83, 1.13] & 1.94 [1.71, 2.17] & 1.43 [1.24, 1.66] & 0.98 [0.85, 1.11] \\  & & & (\(n\) = 214) & (\(n\) = 214) & (\(n\) = 214) \\ \cline{2-6}  & \multirow{2}{*}{Combination} & 1.27 [1.04, 1.5] & 2.08 [1.73, 2.5] & 2 [1.57, 2.48] & 1.18 [0.97, 1.39] \\  & & & (\(n\) = 131) & (\(n\) = 131) & (\(n\) = 131) \\  & Non- & 1.47 [1.31, 1.65] & 2.31 [2.09, 2.54] & 2.05 [1.84, 2.28] & 1.38 [1.22, 1.55] \\  & Combination & & (\(n\) = 455) & (\(n\) = 455) & (\(n\) = 455) \\ \hline \multirow{6}{*}{**Ours**} & \multirow{2}{*}{Ledge} & \multirow{2}{*}{–} & 1.98 [1.69, 2.27] & 2 [1.63, 2.43] & \multirow{2}{*}{–} \\  & & & (\(n\) = 120) & (\(n\) = 120) & \\  & & & 1.46 [0.96, 2.04] & 0.88 [0.5, 1.42] & \\ \cline{1-1}  & & & (\(n\) = 26) & (\(n\) = 26) & \\ \cline{1-1}  & & Quarterpipe & 2.97 [2.56, 3.48] & 3.72 [3.13, 4.36] & 3.63 [2.93, 4.4] & 2.56 [2.09, 3.05] \\ \cline{1-1}  & & (\(n\) = 102) & (\(n\) = 102) & (\(n\) = 102) & (\(n\) = 98) \\ \cline{1-1}  & & Rail & – & 2 [1.77, 2.21] & 1.59 [1.39, 1.81] & \\ \cline{1-1}  & & Bank & 1.19 [1.01, 1.35] & 1.45 [1.08, 1.84] & 1.53 [1.18, 1.94] & 1.26 [1.05, 1.47] \\ \cline{1-1}  & & (\(n\) = 243) & (\(n\) = 49) & (\(n\) = 49) & (\(n\) = 143) \\ \cline{1-1}  & & Gap & – & 2.93 [1.8, 4.31] & 2.13 [1.33, 3.07] & – \\ \cline{1-1}  & & & (\(n\) = 45) & (\(n\) = 45) & (\(n\) = 45) \\ \cline{1-1}  & & 0.94 [0.78, 1.11] & 0.96 [0.57, 1.35] & 1.74 [1.22, 2.48] & 0.98 [0.85, 1.1] \\ \cline{1-1}  & & (\(n\) = 212) & (\(n\) = 23) & (\(n\) = 23) & (\(n\) = 324) \\ \cline{1-1}  & Roll & 1.59 [1.1, 2.07] & – & – & 1.57 [1.1, 2.14] \\ \cline{1-1}  & & (\(n\) = 29) & – & – & (\(n\) = 21) \\ \hline \hline \end{tabular}  
* obstacle\({}_{\text{IA/TA}}\), Frame\({}_{\text{LD}}\)\(\sim\) obstacle\({}_{\text{LO}}\). bootstrapped confidence interval (1000 samples). b Number of TAs may vary across grouping and derived features due to missing data from raters and specific tricks type nuances. c Obstacle type, corresponds to the TA phase (e.g., Frame\({}_{\text{TO}}\)\(\sim\) obstacle\({}_{\text{TO}}\), Frame\({}_{\text{IA-Start}}\) – obstacle\({}_{\text{IA}}\), etc.) d Only grind and slide trick types were included to encompass the majority of TAs involving an obstacle interaction.  
\end{table} 
Table 8: Intra-rater reliability of coded frames (Frame\({}_{\text{TO}}\), Frame\({}_{\text{IA-Start}}\), Frame\({}_{\text{IA-End}}\), Frame\({}_{\text{LD}}\)) from landed trick attempts during the semi-finals round of the Tokyo 2020 Olympics street skateboarding competition. were reliable.