## 2 IberSpeech-RTVE 2018 Evaluation Data  
The RTVE2018 database is a collection of TV shows that belong to diverse genres and broadcast by the public Spanish Television (RTVE) from 2015 to 2018. Table 1 presents the titles, duration, and content of the shows included in the RTVE2018 database. The database is composed of 569 h and 22 min of audio. About 460 h are provided with the subtitles, and about 109 h have been human transcribed. We would like to highlight that in most of the cases, subtitles do not contain verbatim transcriptions of the audio since most of them were generated by a re-speaking procedure (The re-speaker re-utters everything that is being said to a speech-to-text transcription system. Most of the time, the re-speaker summarizes what is being said.). The corpus is divided into four partitions, a training one, two development partitions (dev1 and dev2) and finally, a test partition. Additionally, the corpus includes a set of text files extracted from all the subtitles broadcast by the RTVE 24H Channel during 2017. The training partition consists of all the audio files without human revised transcriptions, which means that only subtitles are available. The training partition can be used for any evaluation task. For development, two partitions are defined. Partition dev1 contains about 53 h of audio and their corresponding human revised transcriptions. The dev1 partition can be used for either development or training of the speech-to-text systems. Partition dev2 contains about 15 h of audio, human revised transcriptions, speaker changes, and their corresponding speaker labels. Additionally, dev2 contains a 2 h show annotated for multimodal diarization (face and speaker) and enrollment files (pictures, videos, and audio) needed for speaker and face identification. Table 2 shows detailed information about the shows included in the development partitions. The RTVE2018 database includes a test partition with all the files needed to evaluate systems for speech-to-text and speaker and multimodal diarization. Table 3 presents the content of the test partition. The test set covers diverse genres from broadcast news, live magazines, quiz shows, to documentary series with a diversity of acoustic scenarios. Additionally, the test partition contains the enrollment files for the multimodal diarization challenge. It consists of 10 pictures and a 20 second video of the 39 characters to be identified. Further detailed information about the RTVE2018 database content and formats can be found in the RTVE2018 database description report ([[http://catedrartve.unizar.es/reto2018/RTVE2018](http://catedrartve.unizar.es/reto2018/RTVE2018) DB.pdf]([http://catedrartve.unizar.es/reto2018/RTVE2018](http://catedrartve.unizar.es/reto2018/RTVE2018) DB.pdf)). The RTVE2018 database is freely available subject to the terms of a license agreement with RTVE ([[http://catedrartve.unizar.es/rtvedatabase.html](http://catedrartve.unizar.es/rtvedatabase.html)]([http://catedrartve.unizar.es/rtvedatabase.html](http://catedrartve.unizar.es/rtvedatabase.html))). \begin{table}
\begin{tabular}{l l l} \hline \hline  & **Show** & **Duration** & **Show Content** \\ \hline
20H & 41:35:50 & News of the day. \\ \hline Agrosfera & 37:34:32 & Agrosfera wants to bring the news of the countryside and the sea to farmers, ranchers, fishermen, and rural inhabitants. The program also aims to bring this rural world closer to those who do not inhabit it, but who do enjoy it. \\ \hline Al filo de lo Imposible & 11:09:57 & This show broadcasts documentaries about mountaineering, climbing, and other outdoor risky sports. It is a documentary series in which emotion, adventure, sports, and risk predominate. \\ \hline Arranca en Verde & 05:38:05 & Contest dedicated to road safety. In it, viewers are presented with questions related to road safety in order to disseminate in a pleasant way the rules of the road and thus raise awareness about civic driving and respect for the environment.