## 3 IberSpeech-RTVE 2018 Evaluation Tasks
### Speaker Diarization Challenge  
#### 3.2.1 Challenge Description and Databases  
The speaker diarization challenge consisted of segmenting broadcast audio documents according to different speakers and linking those segments that originated from the same speaker. No a priori knowledge was provided about the number or the identity of the speakers participating in the audio to be analyzed. The diarization error rate (DER) was used as the scoring metric as defined in the Rich Transcription (RT) evaluations organized by NIST. The open-set and closed-set training conditions were proposed in the challenge. Participants could submit systems in one or both conditions in an independent way.  
Databases  
RTVE2018 database: The RTVE2018 training and development partitions might be used for any purpose including system development or training. In particular, the dev2 partition includes around sixteen hours with diarization and reference speech segmentation corresponding to two different debate shows. There are four episodes (7:26 h) of \"La noche en 24H\" [[http://www.rtve.es/alacarta/videos/la-noche-en-24-horas/](http://www.rtve.es/alacarta/videos/la-noche-en-24-horas/)]([http://www.rtve.es/alacarta/videos/la-noche-en-24-horas/](http://www.rtve.es/alacarta/videos/la-noche-en-24-horas/)), where a group of political analysts comments about the news of the day, and eight episodes (7:42 h) of \"Millennium\" [[http://www.rtve.es/alacarta/videos/millennium/](http://www.rtve.es/alacarta/videos/millennium/)]([http://www.rtve.es/alacarta/videos/millennium/](http://www.rtve.es/alacarta/videos/millennium/)), where a group of experts debates a current issue.  
Aragon Radio database: The database donated by the _Corporacion Aragonesa de Radio y Television_[[http://www.cartv.es/](http://www.cartv.es/)]([http://www.cartv.es/](http://www.cartv.es/)) (CARTV) consisted of around twenty hours of Aragon Radio broadcast. This dataset contains around 85% of speech, 62% of music, and 30% of noise in such a way that 35% of the audio contains music along with speech, 13% is noise along with speech, and 22% is speech alone.  
3/24 TV channel database: The Catalan broadcast news database from the 3/24 TV channel [[http://www.ccma.cat/324/](http://www.ccma.cat/324/)]([http://www.ccma.cat/324/](http://www.ccma.cat/324/)) proposed for the 2010 Albayzin Audio Segmentation Evaluation [7,18] was recorded by the Language and Speech Technologies and Applications Center (TALP) from the Universitat Politecnica de Catalunya (UPC) in 2009 under the Tecnoparla project [[http://rua.ua.es/dspace/handle/10045/8626](http://rua.ua.es/dspace/handle/10045/8626)]([http://rua.ua.es/dspace/handle/10045/8626](http://rua.ua.es/dspace/handle/10045/8626)) funded by the Generalitat de Catalunya. The _Corporacio Catalana de Mitjans Audovisuals_[[http://www.ccma.cat](http://www.ccma.cat)]([http://www.ccma.cat](http://www.ccma.cat)) (CCMA), owner of the multimedia content, allowed its use for technology research and development. The database consists of around 87 h of recordings in which speech can be found in 92% of the segments, music is present 20% of the time, and noise in the background 40%. Another class called _others_ was defined, which can be found 3% of the time. Regarding the overlapped classes, 40% of the time, speech can be found along with noise and 15% of the time, speech along with music.