# Evaluating Novel Speech Transcription Architectures on the Spanish RTVE2020 Database +
## 3 Corpora Description
### Evaluation Data  
The RTVE2020 database served as the principal evaluation test of this work and the Albayzin Speech To Text Transcription Challenge 2020. It is composed of a series of TV shows of different genres which were broadcast by the public Spanish Television (RTVE) from 2018-2019. The database is composed of a total of 55 h and 40 min of audio, and it was fully transcribed by humans to obtain literal references. These references are presented in STM format, which contain time marked segments each including the waveform's filename and channel identifier, the speaker, the begin and end time, optional subset label and the literal transcription of the segment. The type of TV shows included in the database are presented in Table 3.  
\begin{table}
\begin{tabular}{c c} \hline \hline
**Corpus** & **\#Words** \\ \hline Transcriptions & 7,946,991 \\ RTVE2018 & 56,628,710 \\ A la Carta & 106,716,060 \\ Wikipedia & 489,633,255 \\ \hline
**Total** & 660,925,016 \\ \hline \hline \end{tabular}
\end{table}
Table 2: Description of the text corpus.  
As it can be observed in the description of the programs shown in Table 3, most of the TV shows include content with spontaneous speech, thus significantly increasing the difficulty of automatically transcribing this database. Despite the fact that the database is not correctly balanced with respect to the duration of each TV program, most of them share similar artefacts typical of informal speech.  
_Los desyunos de RTVE_ and _Aqui la tierra_ are the two shows with the longest duration in the database. Although in the former some segments with orderly and formal speech can be found, it also includes interviews and political debates. Similarly, _Aqui la tierra_ include formal and informal speech segments as well, combining weather reports usually performed by one speaker with interviews in which spontaneous speech is much more present. The soap opera _Mercado central_ is the third in duration, and its main difficulty is related to the acted and emotional speech, which ASR engines are not usually trained with. Nevertheless, probably the most complex contents correspond to _Como nos reimos_, _Vaya crack_ and _Ese programa del que used me habla_, which together sum up a total of almost ten hours in the database. These contents are composed entirely of spontaneous speech, including sketches, overlapping speech, artistic performances, laughs, fillers, among other artefacts. _Comando actualidad_ adds the difficulty of including spontaneous interviews and reports on the street, whilst _Imprescindibles_ incorporates multi-channel and far-field low quality recordings. Finally, programs like _Millenium_ and _Version espanola_, which sum up to less than five hours, expose a priori a lower difficulty, since they include content with more formal speech, although the latter could integrate parts of movies.  
\begin{table}
\begin{tabular}{c c c} \hline \hline  
In summary, the RTVE2020 database is a challenging evaluation set of Spanish TV shows in which the types of content that generate the greatest problems to the ASR engines today predominate.