title: ÐÐµÐ½ÐµÑÐ°ÑÐ¸Ñ Ð½ÐµÑÐµÑ Ð½Ð¸ÑÐµÑÐºÐ¾Ð³Ð¾ ÑÐµÐ·ÑÐ¼Ðµ Ð´Ð»Ñ Ð½Ð°ÑÑÐ½Ð¾-Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°ÑÐµÐ»ÑÑÐºÐ¸Ñ ÑÑÐ°ÑÐµÐ¹ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð½ÐµÐ¹ÑÐ¾ÑÐµÑÐµÐ¹
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð±Ð°ÐºÐ°Ð»Ð°Ð²ÑÐ°
titleType: Subtitle
title: Generation of lay summaries for scientific articles based on neural networks
Creators: name: Ð¡ÐµÑÐµÐ´Ð¸Ð½, ÐÐ¾Ð½ÑÑÐ°Ð½ÑÐ¸Ð½
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2021
Subjects: Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸ÑÐµÑÐºÐ¾Ðµ ÑÐµÑÐµÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ðµ
Ð¿ÑÐµÐ´Ð²Ð°ÑÐ¸ÑÐµÐ»ÑÐ½Ð°Ñ Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ° Ð´Ð°Ð½Ð½ÑÑ
ÑÐ¸ÑÑÐ°ÑÐ¾Ñ-Ð´ÐµÑÐ¸ÑÑÐ°ÑÐ¾Ñ Ð¼Ð¾Ð´ÐµÐ»Ñ
transformer Ð°ÑÑ Ð¸ÑÐµÐºÑÑÑÐ°
t5
rouge
automatic summarization
data pre-processing
encoder-decoder model
transformer architecture

description: Ð Ð´Ð°Ð½Ð½Ð¾Ð¹ Ð²ÑÐ¿ÑÑÐºÐ½Ð¾Ð¹ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÐµ Ð¾Ð¿Ð¸ÑÐ°Ð½ Ð¿ÑÐ¾ÑÐµÑÑ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ¸ ÑÐ¸ÑÑÐµÐ¼Ñ Ð´Ð»Ñ Ð³ÐµÐ½ÐµÑÐ°ÑÐ¸Ð¸ Ð½ÐµÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¾Ð³Ð¾ ÑÐµÐ·ÑÐ¼Ðµ Ð¸Ð· Ð½Ð°ÑÑÐ½Ð¾ -Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°ÑÐµÐ»ÑÑÐºÐ¸Ñ ÑÑÐ°ÑÐµÐ¹. Ð Ð¿ÐµÑÐ²Ð¾Ð¼ ÑÐ°Ð·Ð´ÐµÐ»Ðµ Ð¸Ð·Ð»Ð¾Ð¶ÐµÐ½ Ð¾Ð±Ð·Ð¾Ñ Ð¿Ð¾Ð´ÑÐ¾Ð´Ð¾Ð² Ð² Ð¾Ð±Ð»Ð°ÑÑÐ¸ Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ ÐµÑÑÐµÑÑÐ²ÐµÐ½Ð½Ð¾Ð³Ð¾ ÑÐ·ÑÐºÐ°. ÐÐ° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð²ÑÐ±ÑÐ°Ð½Ð½Ð¾Ð³Ð¾ Ð¿Ð¾Ð´ÑÐ¾Ð´Ð° ÑÐ°ÑÑÐ¼Ð°ÑÑÐ¸Ð²Ð°ÑÑÑÑ Ð¿ÑÐµÐ¸Ð¼ÑÑÐµÑÑÐ²Ð° ÑÑÑÐµÑÑÐ²ÑÑÑÐ¸Ñ Ð½ÐµÐ¹ÑÐ¾Ð½Ð½ÑÑ Ð¼Ð¾Ð´ÐµÐ»ÐµÐ¹ Ð¸ Ð²ÑÐ±Ð¸ÑÐ°ÐµÑÑÑ Ð½Ð°Ð¸Ð±Ð¾Ð»ÐµÐµ Ð¿Ð¾Ð´ÑÐ¾Ð´ÑÑÐ°Ñ Ð² ÑÐ¾Ð¾ÑÐ²ÐµÑÑÑÐ²Ð¸Ð¸ Ñ Ð¿ÑÐ¸Ð²ÐµÐ´ÐµÐ½Ð½ÑÐ¼Ð¸ ÐºÑÐ¸ÑÐµÑÐ¸ÑÐ¼Ð¸. Ð Ð¿Ð¾ÑÐ»ÐµÐ´ÑÑÑÐ¸Ñ ÑÐ°Ð·Ð´ÐµÐ»Ð°Ñ Ð¾Ð¿Ð¸ÑÑÐ²Ð°ÐµÑÑÑ Ð¿ÑÐ¾ÑÐµÑÑ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ¸ ÑÐ¸ÑÑÐµÐ¼Ñ Ð´Ð»Ñ ÑÐµÑÐµÐ½Ð¸Ñ Ð¿Ð¾ÑÑÐ°Ð²Ð»ÐµÐ½Ð½Ð¾Ð¹ Ð·Ð°Ð´Ð°ÑÐ¸. ÐÑÐ¸Ð²Ð¾Ð´Ð¸ÑÑÑ Ð°ÑÑÐ¸ÑÐµÐºÑÑÑÐ° Ð²ÑÐ±ÑÐ°Ð½Ð½Ð¾Ð¹ Ð¼Ð¾Ð´ÐµÐ»Ð¸, Ð¸ÑÐ¿Ð¾Ð»ÑÐ·ÑÐµÐ¼ÑÐµ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ñ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ð¸ ÑÐ¿Ð¾ÑÐ¾Ð±Ñ Ð¿ÑÐµÐ´Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ Ð´Ð°Ð½Ð½ÑÑ. ÐÐ°Ð»ÐµÐµ Ð¾Ð±Ð¾ÑÐ½Ð¾Ð²ÑÐ²Ð°ÐµÑÑÑ Ð²ÑÐ±Ð¾Ñ Ð±Ð¸Ð±Ð»Ð¸Ð¾ÑÐµÐº Ð¸ Ð¾Ð¿Ð¸ÑÑÐ²Ð°ÑÑÑÑ ÑÑÐ°Ð¿Ñ ÑÑÑÐ°Ð½Ð¾Ð²ÐºÐ¸ Ð¸ Ð½Ð°ÑÑÑÐ¾Ð¹ÐºÐ¸ ÑÑÐµÐ´Ñ. Ð Ð¿Ð¾ÑÐ»ÐµÐ´Ð½ÐµÐ¼ ÑÐ°Ð·Ð´ÐµÐ»Ðµ Ð¿ÑÐ¸Ð²Ð¾Ð´Ð¸ÑÑÑ Ð¾Ð¿Ð¸ÑÐ°Ð½Ð¸Ðµ Ð¼ÐµÑÐ¾Ð´Ð¸Ðº Ð¾ÑÐµÐ½Ð¸Ð²Ð°Ð½Ð¸Ñ Ð¸ Ð¿ÑÐ¾ÑÐµÑÑÐ° Ð¸Ð·Ð¼ÐµÐ½ÐµÐ½Ð¸Ñ Ð³Ð¸Ð¿ÐµÑÐ¿Ð°ÑÐ°Ð¼ÐµÑÑÐ¾Ð² Ð² Ð¼Ð¾Ð´ÐµÐ»Ð¸. Ð ÐºÐ¾Ð½ÑÐµ ÑÐ°Ð·Ð´ÐµÐ»Ð° Ð¿ÑÐ¸Ð²ÐµÐ´ÐµÐ½Ñ ÑÐ³ÐµÐ½ÐµÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð½ÑÐµ ÑÐµÐ·ÑÐ¼Ðµ Ð¸ Ð²ÑÐ²Ð¾Ð´Ñ ÑÐ´ÐµÐ»Ð°Ð½Ð½ÑÐµ, Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ð°Ð½Ð¸Ð¸ Ð¾ÑÐµÐ½Ð¾Ðº, Ð¿Ð¾Ð»ÑÑÐµÐ½Ð½ÑÑ Ð¾Ñ ÑÐµÑÐµÐ½Ð·ÐµÐ½ÑÐ¾Ð².
description: This final qualification paper describes the process of developing a system for generating lay summaries from scientific articles. The first section provides an overview of approaches to natural language processing. Based on the chosen approach, the advantages of existing neural models are considered and the most suitable one is selected in accordance with the specified criteria. The following sections describe the process of developing a system to solve this problem. The architecture of the selected model, the training algorithms used, and the data preprocessing methods are described. At the same time, the selected libraries are explained and the steps for installing and configuring the environment are described. The last section describes the evaluation methods and the process of changing the hyperparameters of the model. At the end of the section, the generated lay summaries and conclusions based on the ratings received from the reviewers are presented.