Extending the M u ST - C Corpus for a Comparative Evaluation of Speech Translation Technology (2022)

Abstract: This project aimed at extending the test sets of the MuST-C speech translation (ST) corpus with new reference translations. The new references were collected from professional post-editors working on the output of different ST systems for three language pairs: English-German/Italian/Spanish. In this paper, we shortly describe how the data were collected and how they are distributed. As an evidence of their usefulness, we also summarise the findings of the first comparative evaluation of cascade and direct ST approaches, which was carried out relying on the collected data. The project was partially funded by the European Association for Machine Translation (EAMT) through its 2020 Sponsorship of Activities programme.

## conclusion in this project we released new high-quality reference translations which extend the en-de/es/it test sets of must-c. these additional references consist of professional post-edits of the output of two state-of-the-art st systems. the collected data are distributed as a special release of must-c, thus providing the community with a valuable resource to foster additional research in the st field. along this direction, we employed this resource to carry out a multi-faceted analysis that resulted in a timely contribution towards taking stock of the situation of st technology advancements.