# Fit for What Purpose? NER Certification of Automatic Captions in English and Spanish
## 4 Results in English
### Detailed Analysis  
A detailed analysis of the scores obtained by [PERSON]'s captions (see Table 3) shows that 89.2% of the errors are minor (that is, they do not impact on the users' comprehension), 10% are standard (they cause confusion or loss of meaning) and 0.8% are serious (they introduce misleading information). The exceptions are 2A_EN, the secondary school science class, where 20% of the errors are standard, and especially 3 EXTRA_EN, the celebrity podcast, which features four times more errors (199 minor, 33 standard and 2 serious) than the captions for the other videos. It is worth noting that in previous studies, the distribution of errors has been closer to 60% minor errors, 35% standard errors and 5% serious errors [20]. This may mean that the errors produced by [PERSON]'s automatic captions are becoming less serious, thus decreasing the impact they may have on users' comprehension. A qualitative analysis shows that 65% of all the errors are caused by incorrect punctuation. Most of these errors are minor and are caused by missing question marks, missing commas (in repetitions and hesitations and in asides), incorrect use of commas and question marks with vocatives (when addressing someone) and missing colons and missing punctuation (comma/colon and inverted commas) when reporting someone's speech. Missing question marks:  
Transcript: How do we hear sounds? Caption: How do we hear sounds  
Transcript: What are the two things every experiment has  
Caption: What are the two things every experiment has? Missing commas:  
In repetitions and hesitations:  
Transcript: The following nine was was prepared. \begin{table}
\begin{tabular}{c c} \hline
**Video** & **NER Score** \\
**(Level and Language)** & **(Accuracy Rate (AR)** \\
**of Subtitle Quality)** \\ \hline
3 EXTRA\_EN & 97.37\% \\ \hline
**AR for Level 3** & **98.82\%** \\ \hline
**AR for all levels** & **99.03\%** \\ \hline \end{tabular}  
* 1A’ refers to the first video of Level 1. ‘EN’ refers to the language of the video, i.e., English. ‘AR’ stands for accuracy rate. The levels in bold are the averages of the separate videos.  
\end{table} 
Table 2: _Cont._ \begin{table}
\begin{tabular}{c c c c c} \hline
**Video** & **NER Score** & **Minor Errors** & **Standard Errors** & **Serious Errors** \\ **(Level and Language)** & **Subtitle Quality)** & & & \\ \hline
1A\_EN & 99.01\% & 79 & 8 & 0 \\ \hline
1B\_EN & 99.56\% & 26 & 4 & 2 \\ \hline
1C\_EN & 99.13\% & 95 & 2 & 0 \\ \hline
2A\_EN & 98.83\% & 53 & 14 & 0 \\ \hline
2B\_EN & 99.27\% & 89 & 4 & 1 \\ \hline
2C\_EN & 99.29\% & 57 & 3 & 0 \\ \hline
3A\_EN & 99.17\% & 60 & 9 & 0 \\ \hline
3B\_EN & 99.32\% & 42 & 4 & 2 \\ \hline
3C\_EN & 99.43\% & 59 & 4 & 0 \\ \hline
3 EXTRA\_EN & 97.37\% & 199 & 33 & 2 \\ \hline \end{tabular}
\end{table} 
Table 3: Detailed NER scores showing the accuracy rates of the English subtitles in the second column, followed by the error division for each video. Caption: The following nine was, was prepared. Transcript: He was a he was very passionate about it. Caption: He was a, he was very passionate about it. Transcript: I think people associate it with, with hate, with, with man hate. Caption: I think people associate it with with hate, with with man hate. In asides:  
Transcript: The second is and this is a real world statement they're cheap. Caption: The second is, and this is a real world statement, they're cheap. Transcript: I was raised where you know respect is given and you deserve it. Caption: I was raised where, you know, respect is given and you deserve it. Incorrect punctuation in the use of commas and question marks with vocatives (when addressing someone):  
Transcript: What does that mean, AJ? Thermal energy tries to enter a place. Caption: What does that mean? AJ, thermal energy tries to enter a place. Missing colon:  
Transcript: Here are two good lessons when you get nervous, you have to...  
Caption: Here are two good lessons: when you get nervous, you have to...