title: Optimizing the Process of Subtitling Educational Videos with Machine Translation Algorithms
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¼Ð°Ð³Ð¸ÑÑÑÐ°
titleType: Subtitle
title: ÐÐ¿ÑÐ¸Ð¼Ð¸Ð·Ð°ÑÐ¸Ñ Ð¿ÑÐ¾ÑÐµÑÑÐ° ÑÑÐ±ÑÐ¸ÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Ð¾Ð±ÑÐ°Ð·Ð¾Ð²Ð°ÑÐµÐ»ÑÐ½ÑÑ Ð²Ð¸Ð´ÐµÐ¾ Ñ Ð¿Ð¾Ð¼Ð¾ÑÑÑ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¿ÐµÑÐµÐ²Ð¾Ð´Ð°
Creators: name: ÐÐ°Ð²ÑÐµÐ½ÑÑÐµÐ²Ð°, ÐÐºÐ°ÑÐµÑÐ¸Ð½Ð°
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2024
Subjects: subtitling
audiovisual texts
educational videos
machine translation
audiovisual translation
ÑÑÐ±ÑÐ¸ÑÑÑ
Ð°ÑÐ´Ð¸Ð¾Ð²Ð¸Ð·ÑÐ°Ð»ÑÐ½ÑÐµ ÑÐµÐºÑÑÑ
Ð¾Ð±ÑÐ°Ð·Ð¾Ð²Ð°ÑÐµÐ»ÑÐ½ÑÐµ Ð²Ð¸Ð´ÐµÐ¾
Ð¼Ð°ÑÐ¸Ð½Ð½ÑÐ¹ Ð¿ÐµÑÐµÐ²Ð¾Ð´
Ð°ÑÐ´Ð¸Ð¾Ð²Ð¸Ð·ÑÐ°Ð»ÑÐ½ÑÐ¹ Ð¿ÐµÑÐµÐ²Ð¾Ð´

description: The graduate qualification work investigates the possibility of integrating machine translation algorithms into the task of subtitling educational video content and, in particular, into the process of creating high-quality English subtitles for Russian video lectures on linguistics from the YouTube channel Postnauka. The method chosen to improve the quality of machine translation-generated subtitles for the lectures is fine-tuning a machine translation model on a large genre-specific corpus of video lecture subtitles. A number of theoretical issues was studied to better understand the problem of automatically subtitling educational videos, such as the nature of the audiovisual text and one of its genres, the educational video, the specifics of audiovisual translation (AVT) and subtitling, and the evolution of and the state-of-the-art in machine translation (MT) algorithms. Previous work in the research area of applying MT in the task of AVT were analyzed and drawn upon. As a result of conducting the experimental study, it was determined that machine translation models translate subtitles coherently when their formatting is changed to the format one line = one sentence. The translation is adequate and fluent except for terminology, which the models struggle to recognize and translate correctly in many cases. After the model was fine-tuned, it started recognizing more terms. These conclusions prove that it is possible to apply machine translation algorithms to subtitling educational videos; however, some pre-editing needs to be done, such as changing the format of the text. The quality of term translation can be improved by augmenting the training corpus with domain-specific data, which is often done with the help of back-translation.
description: Ð Ð´Ð°Ð½Ð½Ð¾Ð¹ Ð²ÑÐ¿ÑÑÐºÐ½Ð¾Ð¹ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÐµ Ð¿Ð¾ ÑÐµÐ¼Ðµ âÐÐ¿ÑÐ¸Ð¼Ð¸Ð·Ð°ÑÐ¸Ñ Ð¿ÑÐ¾ÑÐµÑÑÐ° ÑÑÐ±ÑÐ¸ÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Ð¾Ð±ÑÐ°Ð·Ð¾Ð²Ð°ÑÐµÐ»ÑÐ½ÑÑ Ð²Ð¸Ð´ÐµÐ¾ Ñ Ð¿Ð¾Ð¼Ð¾ÑÑÑ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¿ÐµÑÐµÐ²Ð¾Ð´Ð°â Ð¸ÑÑÐ»ÐµÐ´ÑÐµÑÑÑ Ð²Ð¾Ð·Ð¼Ð¾Ð¶Ð½Ð¾ÑÑÑ Ð¿ÑÐ¸Ð¼ÐµÐ½ÐµÐ½Ð¸Ñ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¿ÐµÑÐµÐ²Ð¾Ð´Ð° Ðº Ð·Ð°Ð´Ð°ÑÐµ ÑÑÐ±ÑÐ¸ÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Ð¾Ð±ÑÐ°Ð·Ð¾Ð²Ð°ÑÐµÐ»ÑÐ½Ð¾Ð³Ð¾ Ð²Ð¸Ð´ÐµÐ¾ÐºÐ¾Ð½ÑÐµÐ½ÑÐ° Ð¸, Ð² ÑÐ°ÑÑÐ½Ð¾ÑÑÐ¸, Ðº Ð¿ÑÐ¾ÑÐµÑÑÑ ÑÐ¾Ð·Ð´Ð°Ð½Ð¸Ñ Ð²ÑÑÐ¾ÐºÐ¾ÐºÐ°ÑÐµÑÑÐ²ÐµÐ½Ð½ÑÑ Ð°Ð½Ð³Ð»Ð¸Ð¹ÑÐºÐ¸Ñ ÑÑÐ±ÑÐ¸ÑÑÐ¾Ð² Ð´Ð»Ñ ÑÑÑÑÐºÐ¸Ñ Ð²Ð¸Ð´ÐµÐ¾Ð»ÐµÐºÑÐ¸Ð¹ Ð¿Ð¾ Ð»Ð¸Ð½Ð³Ð²Ð¸ÑÑÐ¸ÐºÐµ Ð½Ð° YouTube-ÐºÐ°Ð½Ð°Ð»Ðµ Â«ÐÐ¾ÑÑÐ½Ð°ÑÐºÐ°Â». ÐÐµÑÐ¾Ð´Ð¾Ð¼, Ð²ÑÐ±ÑÐ°Ð½Ð½ÑÐ¼ Ð´Ð»Ñ ÑÐ»ÑÑÑÐµÐ½Ð¸Ñ ÐºÐ°ÑÐµÑÑÐ²Ð° Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸ÑÐµÑÐºÐ¸Ñ ÑÑÐ±ÑÐ¸ÑÑÐ¾Ð², ÑÐ²Ð»ÑÐµÑÑÑ Ð´Ð¾Ð¾Ð±ÑÑÐµÐ½Ð¸Ðµ Ð¼Ð¾Ð´ÐµÐ»Ð¸ Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¿ÐµÑÐµÐ²Ð¾Ð´Ð° Ð½Ð° Ð±Ð¾Ð»ÑÑÐ¾Ð¼ Ð¶Ð°Ð½ÑÐ¾Ð²Ð¾-ÑÐ¿ÐµÑÐ¸ÑÐ¸ÑÐ½Ð¾Ð¼ ÐºÐ¾ÑÐ¿ÑÑÐµ ÑÑÐ±ÑÐ¸ÑÑÐ¾Ð² Ð²Ð¸Ð´ÐµÐ¾Ð»ÐµÐºÑÐ¸Ð¹. ÐÑÐ» Ð¸Ð·ÑÑÐµÐ½ ÑÑÐ´ ÑÐµÐ¾ÑÐµÑÐ¸ÑÐµÑÐºÐ¸Ñ Ð²Ð¾Ð¿ÑÐ¾ÑÐ¾Ð² Ð´Ð»Ñ Ð»ÑÑÑÐµÐ³Ð¾ Ð¿Ð¾Ð½Ð¸Ð¼Ð°Ð½Ð¸Ñ Ð¿ÑÐ¾Ð±Ð»ÐµÐ¼Ñ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸ÑÐµÑÐºÐ¾Ð³Ð¾ ÑÐ¾Ð·Ð´Ð°Ð½Ð¸Ñ ÑÑÐ±ÑÐ¸ÑÑÐ¾Ð² Ðº Ð¾Ð±ÑÐ°Ð·Ð¾Ð²Ð°ÑÐµÐ»ÑÐ½ÑÐ¼ Ð²Ð¸Ð´ÐµÐ¾: ÑÐ°ÑÑÐ¼Ð¾ÑÑÐµÐ½Ñ Ð¾ÑÐ¾Ð±ÐµÐ½Ð½Ð¾ÑÑÐ¸ Ð°ÑÐ´Ð¸Ð¾Ð²Ð¸Ð·ÑÐ°Ð»ÑÐ½Ð¾Ð³Ð¾ ÑÐµÐºÑÑÐ° Ð¸ Ð¾Ð±ÑÐ°Ð·Ð¾Ð²Ð°ÑÐµÐ»ÑÐ½Ð¾Ð³Ð¾ Ð²Ð¸Ð´ÐµÐ¾, Ð¸Ð·ÑÑÐµÐ½Ð° ÑÐ¿ÐµÑÐ¸ÑÐ¸ÐºÐ° Ð°ÑÐ´Ð¸Ð¾Ð²Ð¸Ð·ÑÐ°Ð»ÑÐ½Ð¾Ð³Ð¾ Ð¿ÐµÑÐµÐ²Ð¾Ð´Ð° (ÐÐÐ) Ð¸ ÑÑÐ±ÑÐ¸ÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ, Ð° ÑÐ°ÐºÐ¶Ðµ Ð¸ÑÑÐ¾ÑÐ¸Ñ Ð¸ ÑÐ¾Ð²ÑÐµÐ¼ÐµÐ½Ð½Ð¾Ðµ ÑÐ¾ÑÑÐ¾ÑÐ½Ð¸Ðµ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¿ÐµÑÐµÐ²Ð¾Ð´Ð° (ÐÐ). ÐÑÐ»Ð¸ Ð¿ÑÐ¾Ð°Ð½Ð°Ð»Ð¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ñ Ð¸ ÑÑÑÐµÐ½Ñ ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÑ Ð¿ÑÐµÐ´ÑÐ´ÑÑÑÑ ÑÐ°Ð±Ð¾Ñ Ð² Ð¾Ð±Ð»Ð°ÑÑÐ¸ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ð¹ Ð¿ÑÐ¸Ð¼ÐµÐ½ÐµÐ½Ð¸Ñ ÐÐ Ðº Ð·Ð°Ð´Ð°ÑÐµ ÐÐÐ. ÐÑÐ»Ð¾ ÑÑÑÐ°Ð½Ð¾Ð²Ð»ÐµÐ½Ð¾, ÑÑÐ¾ ÐºÐ°ÑÐµÑÑÐ²Ð¾ Ð¿ÐµÑÐµÐ²Ð¾Ð´Ð° Ð¼Ð¾Ð´ÐµÐ»ÑÑ ÑÑÐ±ÑÐ¸ÑÑÐ¾Ð² Ð¿Ð¾Ð²ÑÑÐ°ÐµÑÑÑ, ÐºÐ¾Ð³Ð´Ð° Ð¾Ð½Ð¸ Ð¾ÑÑÐ¾ÑÐ¼Ð°ÑÐ¸ÑÐ¾Ð²Ð°Ð½Ñ ÑÐ¾Ð³Ð»Ð°ÑÐ½Ð¾ Ð¿ÑÐ¸Ð½ÑÐ¸Ð¿Ñ Â«Ð¾Ð´Ð½Ð° ÑÑÑÐ¾ÐºÐ° = Ð¾Ð´Ð½Ð¾ Ð¿ÑÐµÐ´Ð»Ð¾Ð¶ÐµÐ½Ð¸ÐµÂ». ÐÐµÑÐµÐ²Ð¾Ð´ ÑÐ²Ð»ÑÐµÑÑÑ Ð°Ð´ÐµÐºÐ²Ð°ÑÐ½ÑÐ¼ Ð¸ ÐµÑÑÐµÑÑÐ²ÐµÐ½Ð½ÑÐ¼, Ð·Ð° Ð¸ÑÐºÐ»ÑÑÐµÐ½Ð¸ÐµÐ¼ ÑÐµÑÐ¼Ð¸Ð½Ð¾Ð»Ð¾Ð³Ð¸Ð¸, ÐºÐ¾ÑÐ¾ÑÑÑ Ð¼Ð¾Ð´ÐµÐ»Ñ Ñ ÑÑÑÐ´Ð¾Ð¼ ÑÐ°ÑÐ¿Ð¾Ð·Ð½Ð°ÐµÑ. ÐÐ¾ÑÐ»Ðµ Ð´Ð¾Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ð¼Ð¾Ð´ÐµÐ»Ñ Ð½Ð°ÑÐ°Ð»Ð° ÑÐ°ÑÐ¿Ð¾Ð·Ð½Ð°Ð²Ð°ÑÑ Ð±Ð¾Ð»ÑÑÐµÐµ ÐºÐ¾Ð»Ð¸ÑÐµÑÑÐ²Ð¾ ÑÐµÑÐ¼Ð¸Ð½Ð¾Ð². ÐÑÑÐµÐ¿ÐµÑÐµÑÐ¸ÑÐ»ÐµÐ½Ð½ÑÐµ Ð²ÑÐ²Ð¾Ð´Ñ Ð´Ð¾ÐºÐ°Ð·ÑÐ²Ð°ÑÑ, ÑÑÐ¾ Ð¿ÑÐ¸Ð¼ÐµÐ½ÐµÐ½Ð¸Ðµ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¿ÐµÑÐµÐ²Ð¾Ð´Ð° Ð´Ð»Ñ ÑÐ¾Ð·Ð´Ð°Ð½Ð¸Ñ ÑÑÐ±ÑÐ¸ÑÑÐ¾Ð² Ðº ÑÑÐµÐ±Ð½ÑÐ¼ Ð²Ð¸Ð´ÐµÐ¾ÑÐ¾Ð»Ð¸ÐºÐ°Ð¼ Ð²Ð¾Ð·Ð¼Ð¾Ð¶Ð½Ð¾, Ð¾Ð´Ð½Ð°ÐºÐ¾, Ð½ÐµÐ¾Ð±ÑÐ¾Ð´Ð¸Ð¼Ð¾ Ð²ÑÐ¿Ð¾Ð»Ð½Ð¸ÑÑ Ð¿ÑÐµÐ´ÑÐµÐ´Ð°ÐºÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ðµ ÑÑÐ±ÑÐ¸ÑÑÐ¾Ð². ÐÐ°ÑÐµÑÑÐ²Ð¾ Ð¿ÐµÑÐµÐ²Ð¾Ð´Ð° ÑÐµÑÐ¼Ð¸Ð½Ð¾Ð»Ð¾Ð³Ð¸Ð¸ Ð¼Ð¾Ð¶Ð½Ð¾ ÑÐ»ÑÑÑÐ¸ÑÑ, Ð´Ð¾Ð¿Ð¾Ð»Ð½Ð¸Ð² Ð¾Ð±ÑÑÐ°ÑÑÐ¸Ð¹ ÐºÐ¾ÑÐ¿ÑÑ Ð´Ð°Ð½Ð½ÑÐ¼Ð¸, Ð¾ÑÐ½Ð¾ÑÑÑÐ¸Ð¼Ð¸ÑÑ Ðº Ð¿ÑÐµÐ´Ð¼ÐµÑÐ½Ð¾Ð¹ Ð¾Ð±Ð»Ð°ÑÑÐ¸, ÑÑÐ¾ ÑÐ°ÑÑÐ¾ Ð´ÐµÐ»Ð°ÐµÑÑÑ Ñ Ð¿Ð¾Ð¼Ð¾ÑÑÑ Ð¼ÐµÑÐ¾Ð´Ð° Ð¾Ð±ÑÐ°ÑÐ½Ð¾Ð³Ð¾ Ð¿ÐµÑÐµÐ²Ð¾Ð´Ð°.