MULTILINGTOOL , Development of an Automatic Multilingual Subtitling and Dubbing System (2024)

Abstract: In this paper, we present the MULTILINGTOOL project, led by the Elhuyar Foundation and funded by the European Commission under the CREA-MEDIA2022-INNOVBUSMOD call. The aim of the project is to develop an advanced platform for automatic multilingual subtitling and dubbing. It will provide support for Spanish, English, and French, as well as the co-official languages of Spain, namely Basque, Catalan, and Galician.

## introduction over the past two decades, the european audiovisual industry has undergone significant transformation due to advancements in information and communication technologies and shifts in consumer behavior, leading to a market predominantly controlled by a few large corporations. these changes have raised concerns regarding the sustainability of content production by european entities and the maintenance of the continent's cultural diversity. however, artificial intelligence (ai) provides a promising solution for smaller firms, enabling them to access enhanced subtitling and dubbing services in various languages. this technology helps expand their reach and visibility across europe, thus bolstering the industry's diversity and resilience. the multilingtool project (crea-pjg/101093511), led by the elhuyar foundation and financed by the crea-media2022-innovbusmod call, commenced in 2022 and © 2024 the authors. this article is licensed under a creative commons 4.0 licence, no derivative works, attribution, cc-by-nd. ## platform specifications a modular architecture has been developed to support multilingual transcription, neural machine translation, and personalized speech synthesis use cases. emphasizing modularity is key to achieving robust and easily adaptable software.