title: Ð­ÐºÑÐ¿ÐµÑÐ¸Ð¼ÐµÐ½ÑÐ°Ð»ÑÐ½Ð¾Ðµ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ðµ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸ÑÐµÑÐºÐ¾Ð³Ð¾ Ð°Ð½Ð½Ð¾ÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Ð½Ð°ÑÑÐ½ÑÑ ÑÑÐ°ÑÐµÐ¹
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð±Ð°ÐºÐ°Ð»Ð°Ð²ÑÐ°
titleType: Subtitle
title: Experimental research of algorithms for automatic annotation of scientific articles
Creators: name: Ð¡Ð¼Ð°Ð³Ð¸Ð½Ð°, ÐÐ»ÐµÐºÑÐ°Ð½Ð´ÑÐ°
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2023
Subjects: Ð°Ð½Ð½Ð¾ÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ðµ
TextRank
SumBasic
BertSumExt
BART
annotation

description: Ð¦ÐµÐ»Ñ ÑÐ°Ð±Ð¾ÑÑ â Ð²ÑÐ¿Ð¾Ð»Ð½Ð¸ÑÑ ÑÐºÑÐ¿ÐµÑÐ¸Ð¼ÐµÐ½ÑÐ°Ð»ÑÐ½ÑÐ¹ ÑÑÐ°Ð²Ð½Ð¸ÑÐµÐ»ÑÐ½ÑÐ¹ Ð°Ð½Ð°Ð»Ð¸Ð· Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð°Ð½Ð½Ð¾ÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Ð½Ð° ÐºÐ¾ÑÐ¿ÑÑÐµ ÑÑÑÑÐºÐ¾ÑÐ·ÑÑÐ½ÑÑ ÑÑÐ°ÑÐµÐ¹. ÐÐ±ÑÐµÐºÑÐ¾Ð¼ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ ÑÐ²Ð»ÑÐµÑÑÑ Ð°Ð½Ð½Ð¾ÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ðµ. ÐÑÐµÐ´Ð¼ÐµÑÐ¾Ð¼ â Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ñ Ð°Ð½Ð½Ð¾ÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ. Ð ÐºÐ°ÑÐµÑÑÐ²Ðµ Ð¼ÐµÑÐ¾Ð´Ð¾Ð² Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·ÑÑÑÑÑ Ð³ÑÐ°ÑÐ¸ÑÐµÑÐºÐ¸Ð¹, ÑÐ¸ÑÑÐµÐ¼Ð½ÑÐ¹ Ð¸ ÑÑÐ°Ð²Ð½Ð¸ÑÐµÐ»ÑÐ½ÑÐ¹ Ð°Ð½Ð°Ð»Ð¸Ð·Ñ, ÑÐºÑÐ¿ÐµÑÐ¸Ð¼ÐµÐ½ÑÑ Ð¸ Ð¼ÐµÑÐ¾Ð´Ñ ÑÑÐ°ÑÐ¸ÑÑÐ¸ÐºÐ¸. ÐÐ°Ð´Ð°ÑÐ¸, ÐºÐ¾ÑÐ¾ÑÑÐµ ÑÐµÑÐ°Ð»Ð¸ÑÑ Ð²ÑÐ¾Ð´Ðµ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ: A. ÐÐ·ÑÑÐµÐ½Ð¸Ðµ ÑÐ°Ð·Ð»Ð¸ÑÐ½ÑÑ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸ÑÐµÑÐºÐ¾Ð³Ð¾ Ð°Ð½Ð½Ð¾ÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ. B. ÐÐ¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð¸Ðµ Ð¼ÐµÑÑÐ¸Ðº Ð¾ÑÐµÐ½ÐºÐ¸ ÐºÐ°ÑÐµÑÑÐ²Ð° ÑÐ°Ð±Ð¾ÑÑ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð². C. Ð ÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð½Ð° Ð²ÑÐ±ÑÐ°Ð½Ð½Ð¾Ð¼ ÑÐ·ÑÐºÐµ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Ñ Ð¿Ð¾Ð»ÑÑÐµÐ½Ð¸ÐµÐ¼ Ð¾ÑÐµÐ½Ð¾Ðº Ð¿Ð¾ Ð¼ÐµÑÑÐ¸ÐºÐµ. D. Ð¡ÑÐ°Ð²Ð½Ð¸ÑÐµÐ»ÑÐ½ÑÐ¹ Ð°Ð½Ð°Ð»Ð¸Ð· ÑÐµÐ°Ð»Ð¸Ð·Ð¾Ð²Ð°Ð½Ð½ÑÑ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð². Ð Ð¿ÑÐ¾ÑÐµÑÑÐµ ÑÐ°Ð±Ð¾ÑÑ Ð±ÑÐ» Ð¿ÑÐ¾Ð²ÐµÐ´ÐµÐ½ Ð°Ð½Ð°Ð»Ð¸Ð· Ð»Ð¸ÑÐµÑÐ°ÑÑÑÑ, ÑÐ²ÑÐ·Ð°Ð½Ð½Ð¾Ð¹ Ñ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð°Ð¼Ð¸ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸ÑÐµÑÐºÐ¾Ð³Ð¾ Ð°Ð½Ð½Ð¾ÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ. ÐÐ½Ð°Ð»Ð¸Ð· Ð¿Ð¾Ð·Ð²Ð¾Ð»Ð¸Ð» Ð²ÑÐ±ÑÐ°ÑÑ 4 Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð°: SumBasic, TextRank, BertSumExt Ð¸ BART. ÐÐ¾ Ð¾ÑÐµÐ½ÐºÐµ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ Ð¼ÐµÑÑÐ¸Ðº ÐºÐ°ÑÐµÑÑÐ²Ð° Ð°Ð½Ð½Ð¾ÑÐ°ÑÐ¸Ð¹ Ð±ÑÐ»Ð° Ð¾Ð¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð° Ð¼ÐµÑÑÐ¸ÐºÐ° ROUGE. ÐÑÐ»Ð¸ Ð¸Ð·ÑÑÐµÐ½Ñ ÑÑÐ°Ð¿Ñ Ð¸ Ð¼ÐµÑÐ¾Ð´Ñ Ð¿ÑÐµÐ´Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ ÑÐµÐºÑÑÐ¾Ð²ÑÑ Ð´Ð°Ð½Ð½ÑÑ, Ñ Ð²ÑÐ´ÐµÐ»ÐµÐ½Ð¸ÐµÐ¼ Ð¼ÐµÑÐ¾Ð´Ð¾Ð², ÐºÐ¾ÑÐ¾ÑÑÐµ Ð±ÑÐ´ÑÑ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°ÑÑÑÑ Ð¿ÑÐ¸ Ð°Ð½Ð°Ð»Ð¸Ð·Ðµ. Ð ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐµ Ð±ÑÐ» Ð¿Ð¾Ð»ÑÑÐµÐ½ ÑÑÐ°Ð²Ð½Ð¸ÑÐµÐ»ÑÐ½ÑÐ¹ Ð¸ Ð³ÑÐ°ÑÐ¸ÑÐµÑÐºÐ¸Ð¹ Ð°Ð½Ð°Ð»Ð¸Ð·Ñ ÑÐµÑÑÑÑÑ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð², Ð¿Ð¾ Ð¸ÑÐ¾Ð³Ð°Ð¼ ÐºÐ¾ÑÐ¾ÑÑÑ Ð½Ð°Ð¸Ð±Ð¾Ð»ÐµÐµ ÑÐ¸Ð»ÑÐ½ÑÐ¼Ð¸ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð°Ð¼Ð¸ ÑÐ²Ð»ÑÑÑÑÑ BertSumExt Ð¸ BART. Ð ÐµÐ·ÑÐ»ÑÑÐ°ÑÑ Ð´Ð°Ð½Ð½Ð¾Ð³Ð¾ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° Ð¼Ð¾Ð³ÑÑ Ð±ÑÑÑ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ñ Ð´Ð»Ñ Ð´Ð°Ð»ÑÐ½ÐµÐ¹ÑÐµÐ³Ð¾ ÑÐ¾Ð²ÐµÑÑÐµÐ½ÑÑÐ²Ð¾Ð²Ð°Ð½Ð¸Ñ ÑÐ¸ÑÑÐµÐ¼ Ð°Ð½Ð½Ð¾ÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Ð¸ Ð¿Ð¾Ð²ÑÑÐµÐ½Ð¸Ñ ÑÑÑÐµÐºÑÐ¸Ð²Ð½Ð¾ÑÑÐ¸ Ð¸Ñ ÑÐ°Ð±Ð¾ÑÑ.Â 
description: The purpose of the work is an experimental comparative analysis of annotation algorithms in the corpus of russian-language articles. The object of the study is annotation. The subject is the annotation algorithm. Graphical, systemic and comparative analyses, experiments and statistical methods are used as research methods. The research set the following goals: A. Studying different automatic annotation algorithms. B. Definition of metrics for assessing the quality of algorithms. C. Implementation of algorithms in the selected programming language with obtaining estimates of the speed of work and memory consumption. D. Comparative analysis of implemented algorithms. During the work, an analysis of the literature related to automatic annotation algorithms was conducted. The analysis made it possible to select four algorithms: SumBasic, TextRank, BertSumExt and BART. A study of annotation quality metrics identified a ROUGE metric. The stages and methods of text data preprocessing were studied, with the identification of methods that will be used in analysis. Consequently, a comparative and graphical analysis of four algorithms was obtained, as a result of which the most powerful algorithms are BertSumExt and BART. The results of this analysis were used to consistently apply the annotation system and evaluate performance.