# An Overview of the IberSpeech-RTVE 2022 Challenges on Speech Technologies
## 5 IberSpeech-RTVE 2022 Results and Discussion
### Speaker Diarization and Identity Assignment Challenge  
The results of the Speaker Diarization challenge are presented in Table 13. The table presents the results of the two participating teams and reference results using the best system in the previous 2020 challenge. It is noteworthy the low DER, 18.47%, obtained by IRIT using pyannote.audio. This system gives a 16% of DER over the 2020 dataset, a little \begin{table}
\begin{tabular}{c c c c c c} \hline
**Show Code** & **BCN2 BRNO(P)** & **VICOM-UPM(C)** & **WHISPER** & **BEST WER** & **Best System** \\ \hline \(3\times 4\) & 13.11 & 13.37 & 14.78 & 12.60 & VICOM-UPM(P) \\ \hline AG & **5.89** & 6.72 & 6.16 & 5.89 & BCN2 BRNO(P) \\ \hline APB & 49.85 & 60.24 & 67.05 & 47.79 & UZ(P) \\ \hline AT & 11.16 & 11.65 & **9.60** & 9.60 & Whisper \\ \hline ATe & 9.47 & 9.07 & **7.92** & 7.92 & Whisper \\ \hline CA & **17.71** & 19.09 & 21.30 & 17.71 & BCN2 BRNO(P) \\ \hline CCA & 10.31 & **9.51** & 11.93 & 9.51 & VICOM-UPM(C1) \\ \hline CO & 8.55 & **7.89** & 9.88 & 7.89 & VICOM-UPM(C1) \\ \hline CPE & 13.87 & **13.46** & 14.57 & 13.46 & VICOM-UPM(C1) \\ \hline EC & 13.61 & 14.32 & **13.45** & 13.45 & Whisper \\ \hline ED & 14.38 & 14.21 & **13.36** & 13.36 & Whisper \\ \hline EE & 23.55 & 25.16 & **22.20** & 22.20 & Whisper \\ \hline ERA & 22.08 & 19.88 & **18.80** & 18.80 & Whisper \\ \hline GR & 26.63 & 29.02 & 31.08 & 24.79 & VICOM-UPM(P) \\ \hline IU & 20.36 & 19.79 & **19.50** & 19.50 & Whisper \\ \hline JYS & 11.79 & 12.04 & 11.74 & 10.69 & VICOM-UPM(C2) \\ \hline NN & **9.33** & 10.20 & 10.49 & 9.33 & BCN2 BRNO(P) \\ \hline RD & 20.60 & 23.30 & 20.84 & 18.18 & VICOM-UPM(P) \\ \hline SYG & **10.05** & 10.24 & 10.07 & 10.05 & BCN2 BRNO(P) \\ \hline TO & 23.98 & **20.61** & 24.91 & 20.61 & VICOM-UPM(C1) \\ \hline YR & 29.74 & 25.33 & **21.48** & 21.48 & Whisper \\ \hline TOTAL & **14.35** & 14.78 & 14.87 & 14.35 & BCN2 BRNO(P) \\ \hline \end{tabular}
\end{table} 
Table 12: WER performance across challenges (2018, 2020 and 2022) on three different shows. The Best System figures are computed on the whole test dataset of each challenge. \begin{table}
\begin{tabular}{c c c c c} \hline
**Show** & **2018** & **2020** & **2022** & **WER Improvement** \\ \hline AT & - & 13.93\% & 9.26\% & 31.1\% \\ \hline CA & - & 20.90\% & 17.71\% & 15.2\% \\ \hline SyG & 14.77\% & - & 10.05\% & 31.9\% \\ \hline Best System & 16.45\% & 16.04\% & 14.35\% & 10.5\% \\ \hline \end{tabular}
\end{table} 
Table 11: Speech to Text challenge: Best WER (%) by show. The WER for the 3 best systems (TOTAL WER \(<\) 15%) is shown jointly with the best WER among all systems. bit higher than the DER, 15.25%, of the best 2020 system. However, the performance of the best 2020 speaker diarization system degrades to 34.29% on the new 2022 test dataset. Table 14 presents diarization results disaggregated by show for the best system in terms of missed speaker error (MiSE), false alarm speaker error (FASE), speaker error (SpE) and diarization error (DER). Again, as in the Speech to Text challenge, the \"Agrosfera\" show gives the best results with the lowest DER of 8.57%, mainly due to speaker errors. The worst results, as expected, are given by the serial drama shows, with the worst results, 56.47% of DER, for the Yreal show. This show is a thriller with live action and many overlaps of music and speech with regard to the other serial dramas in the test set. With respect to the Speaker Diarization and Identity Assignment challenge, only the team from Intelligent Voice (IV) presented results. The IV team submitted several systems where the main difference was the VAD and the use of a Deep-Encoder Convolutional Autoencoder Denoiser (DE-CADE) speech enhancement model. The final system submitted by the IV team implemented an SNR classifier to decide whether or not to employ the DE-CADE speech enhancement algorithm on the input audio signals for inference based on the SNR threshold of 0.2, and a final 28.88% AER was reported. Table 15 shows the results of the 4 submissions of the IV team.