title: ÐÑÐ¾Ð±ÐµÐ½Ð½Ð¾ÑÑÐ¸ Ð¿ÑÐ¸Ð¼ÐµÐ½ÐµÐ½Ð¸Ñ Ð¼ÐµÑÐ¾Ð´Ð¸Ðº Ð¸Ð·Ð¼ÐµÑÐµÐ½Ð¸Ñ ÐºÐ°ÑÐµÑÑÐ²Ð° Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¿ÐµÑÐµÐ²Ð¾Ð´Ð° (Ð½Ð° Ð¿ÑÐ¸Ð¼ÐµÑÐµ ÑÐµÐºÑÑÐ¾Ð² Ð½ÐµÑÑÐµÐ³Ð°Ð·Ð¾Ð²Ð¾Ð¹ Ð¾ÑÑÐ°ÑÐ»Ð¸)
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¼Ð°Ð³Ð¸ÑÑÑÐ°
titleType: Subtitle
title: Machine translation quality measurement techniques for oil and gas industry texts
Creators: name: ÐÐ¸Ð»ÑÐµÐ², ÐÐ»ÐµÐºÑÐµÐ¹
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2024
Subjects: Ð¼Ð°ÑÐ¸Ð½Ð½ÑÐ¹ Ð¿ÐµÑÐµÐ²Ð¾Ð´ (ÐÐ)
ÐºÐ°ÑÐµÑÑÐ²Ð¾
Ð¼ÐµÑÐ¾Ð´Ð¸ÐºÐ¸ Ð¾ÑÐµÐ½ÐºÐ¸
Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸ÑÐµÑÐºÐ¸Ðµ Ð¼ÐµÑÑÐ¸ÐºÐ¸
Ð¿Ð¾ÑÑÑÐµÐ´Ð°ÐºÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ðµ
ÑÐµÐºÑÑÑ Ð½ÐµÑÑÐµÐ³Ð°Ð·Ð¾Ð²Ð¾Ð¹ Ð¾ÑÑÐ°ÑÐ»Ð¸
machine translation (MT)
quality
evaluation methods
automatic metrics
post-editing
oil and gas industry texts

description: Ð ÑÐ¾Ð´Ðµ ÑÐ°Ð±Ð¾ÑÑ Ð±ÑÐ»Ð¸ Ð¿ÑÐ¾Ð°Ð½Ð°Ð»Ð¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ñ ÑÑÑÐµÑÑÐ²ÑÑÑÐ¸Ðµ Ð¼ÐµÑÐ¾Ð´Ð¸ÐºÐ¸ Ð¸ Ð¼ÐµÑÑÐ¸ÐºÐ¸ Ð¾ÑÐµÐ½ÐºÐ¸ Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¿ÐµÑÐµÐ²Ð¾Ð´Ð° Ð¸ ÑÑÑÐµÐºÑÐ¸Ð²Ð½Ð¾ÑÑÑ Ð¸Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸Ñ Ð¿ÑÐ¸ Ð¿Ð¾ÑÑÑÐµÐ´Ð°ÐºÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ð¸ ÑÐµÐºÑÑÐ¾Ð² Ð½ÐµÑÑÐµÐ³Ð°Ð·Ð¾Ð²Ð¾Ð¹ Ð¾ÑÑÐ°ÑÐ»Ð¸.Â  ÐÑÐ»Ð¸ Ð¾Ð¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ñ ÐºÑÐ¸ÑÐµÑÐ¸Ð¸ Ð¾ÑÐµÐ½ÐºÐ¸ Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¿ÐµÑÐµÐ²Ð¾Ð´Ð°. ÐÐ° Ð¾ÑÐ½Ð¾Ð²Ðµ ÑÐ°ÑÑÐ¼Ð¾ÑÑÐµÐ½Ð½ÑÑ ÐºÑÐ¸ÑÐµÑÐ¸ÐµÐ² Ð¸ ÑÐ¿Ð¾ÑÐ¾Ð±Ð¾Ð² Ð±ÑÐ»Ð¸ Ð²ÑÐ±ÑÐ°Ð½Ñ Ð´Ð²Ðµ Ð¼ÐµÑÐ¾Ð´Ð¸ÐºÐ¸ Ð¾ÑÐµÐ½ÐºÐ¸ ÐÐ Ð¸ Ð¿ÑÐµÐ´ÑÑÐ°Ð²Ð»ÐµÐ½Ð¾ Ð¿Ð¾Ð»Ð½Ð¾Ðµ Ð¾Ð¿Ð¸ÑÐ°Ð½Ð¸Ðµ Ð¸Ñ ÑÐ¸ÑÑÐµÐ¼ ÑÐ°ÑÑÐµÑÐ° ÐºÐ°ÑÐµÑÑÐ²Ð° Ð¾ÑÐµÐ½ÐºÐ¸ ÐÐ. Ð¢Ð°ÐºÐ¶Ðµ Ð±ÑÐ» Ð¿ÑÐ¾Ð¸Ð·Ð²ÐµÐ´ÐµÐ½ Ð°Ð½Ð°Ð»Ð¸Ð· ÑÑÑÐµÑÑÐ²ÑÑÑÐ¸Ñ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸ÑÐµÑÐºÐ¸Ñ Ð¼ÐµÑÑÐ¸Ðº ÐÐ. Ð Ð°ÑÑÐ¼Ð¾ÑÑÐµÐ½Ñ Ð¸Ñ ÐºÐ»Ð°ÑÑÐ¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¸ Ð¸ Ð¿ÑÐ¸Ð½ÑÐ¸Ð¿ ÑÐ°Ð±Ð¾ÑÑ Ð¸ Ð²ÑÐ±ÑÐ°Ð½Ñ Ð´Ð²Ðµ Ð¼ÐµÑÑÐ¸ÐºÐ¸ Ð´Ð»Ñ Ð¿Ð¾ÑÐ»ÐµÐ´ÑÑÑÐµÐ¹ Ð¾ÑÐµÐ½ÐºÐ¸ ÐÐ. ÐÑÐ´ÐµÐ»ÐµÐ½Ñ Ð¾ÑÐ½Ð¾Ð²Ð½ÑÐµ Ð¾ÑÐ¾Ð±ÐµÐ½Ð½Ð¾ÑÑÐ¸ ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ñ ÑÐµÐºÑÑÐ¾Ð², Ðº ÐºÐ¾ÑÐ¾ÑÑÐ¼ ÑÐ°ÐºÐ¶Ðµ Ð¾ÑÐ½Ð¾ÑÑÑÑÑ ÑÐµÐºÑÑÑ Ð½ÐµÑÑÐµÐ³Ð°Ð·Ð¾Ð²Ð¾Ð¹ Ð¾ÑÑÐ°ÑÐ»Ð¸. Ð Ð¾ÑÐ¾Ð±ÑÐ°Ð½Ð½ÑÑ ÑÐµÐºÑÑÐ°Ñ Ð´Ð»Ñ Ð¾ÑÐµÐ½ÐºÐ¸ ÐºÐ°ÑÐµÑÑÐ²Ð° ÐÐ Ð±ÑÐ»Ð¸ Ð²ÑÐ´ÐµÐ»ÐµÐ½Ñ Ð¾ÑÐ¸Ð±ÐºÐ¸ Ð¸ ÑÐ¾ÑÑÐ°Ð²Ð»ÐµÐ½Ð° ÑÑÐ°ÑÐ¸ÑÑÐ¸ÐºÐ° Ð¿Ð¾ Ð½Ð°Ð¸Ð±Ð¾Ð»ÐµÐµ ÑÐ°ÑÑÐ¾ Ð²ÑÑÑÐµÑÐ°ÑÑÐ¸Ð¼ÑÑ Ð¾ÑÐ¸Ð±ÐºÐ°Ð¼. ÐÐ° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° Ð¾ÑÐ¾Ð±ÑÐ°Ð½Ð½ÑÑ ÑÐµÐºÑÑÐ¾Ð² Ð±ÑÐ»Ð° Ð¿ÑÐ¾Ð¸Ð·Ð²ÐµÐ´ÐµÐ½Ð° Ð¾ÑÐµÐ½ÐºÐ° ÐÐ Ð¸ Ð²ÑÐ¿Ð¾Ð»Ð½ÐµÐ½Ð¾ ÑÑÐ°Ð²Ð½ÐµÐ½Ð¸Ðµ Ð¿Ð¾Ð»ÑÑÐµÐ½Ð½ÑÑ ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐ¾Ð², Ð° ÑÐ°ÐºÐ¶Ðµ ÑÐ´ÐµÐ»Ð°Ð½Ñ Ð²ÑÐ²Ð¾Ð´Ñ Ð¾ ÐºÐ¾ÑÑÐµÐ»ÑÑÐ¸Ð¸ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸ÑÐµÑÐºÐ¸Ñ Ð¼ÐµÑÑÐ¸Ðº Ð¸ ÑÐºÑÐ¿ÐµÑÑÐ½ÑÑ Ð¼ÐµÑÐ¾Ð´Ð¸Ðº Ð¸ Ð¸Ñ ÑÑÑÐµÐºÑÐ¸Ð²Ð½Ð¾ÑÑÐ¸ Ð¿ÑÐ¸Ð¼ÐµÐ½Ð¸ÑÐµÐ»ÑÐ½Ð¾ Ðº Ð¿Ð¾ÑÑÑÐµÐ´Ð°ÐºÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ.
description: The research studies the methods and metrics for MT evaluation, the efficiency of its application in post-editing of oil and gas industry texts. The evaluation criteria were determined for MT texts. The methods and metrics for MT quality evaluation were described. The analysis was conducted, comprising the methods classification and their full description. Two evaluation methods and two metrics were chosen based on the analysis. The key features of technical texts, including oil and gas industry texts, were highlighted. The errors of MT were determined that resulted in statistics of the errors ratio in the selected texts. Based on the analysis, the texts evaluation was carried out. The results were used to draw the comparisons between human evaluation methods and automated evaluation metrics as well as to determine the correlation between them. The conclusions were drawn on the efficiency of evaluation methods in post-editing.