title: Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð¼Ð¾Ð´ÐµÐ»Ð¸ Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸ÐµÐ¼ ÑÑÐ°Ð½ÑÑÐ¾ÑÐ¼ÐµÑÐ° Ð´Ð»Ñ Ð¾ÑÐµÐ½ÐºÐ¸ Ð½Ð¾Ð²Ð¸Ð·Ð½Ñ Ð½Ð°ÑÑÐ½ÑÑ ÑÑÐ°ÑÐµÐ¹
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¼Ð°Ð³Ð¸ÑÑÑÐ°
titleType: Subtitle
title: Development of an automated system based on deep learning and natural language processing for assessing the novelty of scientific and technical articles
Creators: name: ÐÐ¸ Ð¡ÑÑÐ°Ð½Ñ
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2024
Subjects: Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ð½Ð°Ñ ÑÐ¸ÑÑÐµÐ¼Ð°
Ð³Ð»ÑÐ±Ð¾ÐºÐ¾Ðµ Ð¾Ð±ÑÑÐµÐ½Ð¸Ðµ
Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ° ÐµÑÑÐµÑÑÐ²ÐµÐ½Ð½Ð¾Ð³Ð¾ ÑÐ·ÑÐºÐ°
Ð¾ÑÐµÐ½ÐºÐ° Ð½Ð¾Ð²Ð¸Ð·Ð½Ñ
ÑÐ°ÑÐ¿Ð¾Ð·Ð½Ð°Ð²Ð°Ð½Ð¸Ðµ ÑÑÑÐ½Ð¾ÑÑÐµÐ¹
ÑÐ²ÑÐ·Ñ Ð¼ÐµÑÐ¾Ð´-Ð·Ð°Ð´Ð°ÑÐ°
Ð°Ð½Ð°Ð»Ð¸Ð· Ð½Ð°ÑÑÐ½Ð¾Ð¹ Ð»Ð¸ÑÐµÑÐ°ÑÑÑÑ
automated system
deep learning
natural language processing
novelty assessment
entity recognition
method-task relation
scientific literature analysis

description: ÐÐ°Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¿Ð¾ÑÐ²ÑÑÐµÐ½Ð° ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐµ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ð½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð³Ð»ÑÐ±Ð¾ÐºÐ¾Ð³Ð¾ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ð¸ Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ ÐµÑÑÐµÑÑÐ²ÐµÐ½Ð½Ð¾Ð³Ð¾ ÑÐ·ÑÐºÐ° Ð´Ð»Ñ Ð¾ÑÐµÐ½ÐºÐ¸ Ð½Ð¾Ð²Ð¸Ð·Ð½Ñ Ð½Ð°ÑÑÐ½Ð¾-ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ñ ÑÑÐ°ÑÐµÐ¹.ÐÑÑÐ¾ÑÐ¸Ñ ÑÐ°Ð·Ð²Ð¸ÑÐ¸Ñ Ð½Ð°ÑÐºÐ¸ Ð¸ ÑÐµÑÐ½Ð¸ÐºÐ¸ Ð¿Ð¾Ð»Ð½Ð° Ð·Ð½Ð°ÑÐ¸ÑÐµÐ»ÑÐ½ÑÐ¼Ð¸ Ð¿ÑÐ¾ÑÑÐ²Ð°Ð¼Ð¸ Ð¸ ÑÐµÐ¾ÑÐµÑÐ¸ÑÐµÑÐºÐ¸Ð¼Ð¸ Ð¸Ð½Ð½Ð¾Ð²Ð°ÑÐ¸ÑÐ¼Ð¸, ÐºÐ°Ð¶Ð´ÑÐ¹ Ð¸Ð· ÐºÐ¾ÑÐ¾ÑÑÑ ÑÐ¿Ð¾ÑÐ¾Ð±ÑÑÐ²Ð¾Ð²Ð°Ð» Ð¿ÑÐ¾Ð³ÑÐµÑÑÑ ÑÐµÐ»Ð¾Ð²ÐµÑÐµÑÑÐ²Ð°. ÐÐ°ÑÐ¸Ð½Ð°Ñ Ñ 19 Ð²ÐµÐºÐ°, Ð¿Ð¾ Ð¼ÐµÑÐµ Ð±ÑÑÑÑÐ¾Ð³Ð¾ ÑÐ°Ð·Ð²Ð¸ÑÐ¸Ñ ÑÐµÑÐ½Ð¾Ð»Ð¾Ð³Ð¸Ð¹, ÐºÐ¾Ð»Ð¸ÑÐµÑÑÐ²Ð¾ Ð¿ÑÐ±Ð»Ð¸ÐºÐ°ÑÐ¸Ð¹ Ð² Ð½Ð°ÑÑÐ½Ð¾Ð¹ Ð»Ð¸ÑÐµÑÐ°ÑÑÑÐµ ÑÐ°ÐºÐ¶Ðµ Ð±ÑÑÑÑÐ¾ ÑÐ²ÐµÐ»Ð¸ÑÐ¸Ð²Ð°Ð»Ð¾ÑÑ, ÑÑÐ¾ ÑÐ¾Ð·Ð´Ð°Ð²Ð°Ð»Ð¾ Ð²ÑÐ·Ð¾Ð²Ñ Ð´Ð»Ñ ÑÑÐ°Ð´Ð¸ÑÐ¸Ð¾Ð½Ð½ÑÑ Ð¿ÑÐ¾ÑÐµÑÑÐ¾Ð² ÑÐµÑÐµÐ½Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ. ÐÐ¾Ð²Ð¸Ð·Ð½Ð° ÑÐ²Ð»ÑÐµÑÑÑ Ð¾ÑÐ½Ð¾Ð²Ð½ÑÐ¼ ÐºÑÐ¸ÑÐµÑÐ¸ÐµÐ¼ Ð¿ÑÐ¸ Ð¾ÑÐµÐ½ÐºÐµ ÑÑÐ°ÑÐµÐ¹. ÐÐ»Ñ ÑÐµÑÐµÐ½Ð¸Ñ Ð¿ÑÐ¾Ð±Ð»ÐµÐ¼Ñ Ð¾ÑÐµÐ½ÐºÐ¸ Ð½Ð¾Ð²Ð¸Ð·Ð½Ñ Ð² Ð´Ð°Ð½Ð½Ð¾Ð¼ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ð¸ Ð¿ÑÐµÐ´Ð»Ð¾Ð¶ÐµÐ½Ð° ÑÐ¸ÑÑÐµÐ¼Ð°, Ð¾Ð±ÑÐµÐ´Ð¸Ð½ÑÑÑÐ°Ñ ÑÐ°ÑÐ¿Ð¾Ð·Ð½Ð°Ð²Ð°Ð½Ð¸Ðµ ÑÑÑÐ½Ð¾ÑÑÐµÐ¹, Ð¸Ð·Ð²Ð»ÐµÑÐµÐ½Ð¸Ðµ ÑÐ²ÑÐ·ÐµÐ¹ Ð¼ÐµÐ¶Ð´Ñ ÑÑÑÐ½Ð¾ÑÑÑÐ¼Ð¸ Ð¸ ÑÐ°ÑÑÐµÑ Ð¿Ð¾ÐºÐ°Ð·Ð°ÑÐµÐ»Ñ Ð½Ð¾Ð²Ð¸Ð·Ð½Ñ. Ð¡Ð¸ÑÑÐµÐ¼Ð° Ð¸ÑÐ¿Ð¾Ð»ÑÐ·ÑÐµÑ Ð¿ÐµÑÐµÐ´Ð¾Ð²ÑÐµ ÑÐµÑÐ½Ð¾Ð»Ð¾Ð³Ð¸Ð¸ ÑÐ°ÑÐ¿Ð¾Ð·Ð½Ð°Ð²Ð°Ð½Ð¸Ñ ÑÑÑÐ½Ð¾ÑÑÐµÐ¹ Ð´Ð»Ñ Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ Ð·Ð°Ð³Ð¾Ð»Ð¾Ð²ÐºÐ¾Ð² Ð¸ Ð°Ð½Ð½Ð¾ÑÐ°ÑÐ¸Ð¹ Ð»Ð¸ÑÐµÑÐ°ÑÑÑÑ, ÑÑÐ¾Ð±Ñ ÑÐ¾ÑÐ½Ð¾ Ð¸Ð´ÐµÐ½ÑÐ¸ÑÐ¸ÑÐ¸ÑÐ¾Ð²Ð°ÑÑ ÑÑÑÐ½Ð¾ÑÑÐ¸ "Ð¼ÐµÑÐ¾Ð´Ñ" Ð¸ "Ð·Ð°Ð´Ð°ÑÐ¸". ÐÐ°ÑÐµÐ¼, Ñ Ð¿Ð¾Ð¼Ð¾ÑÑÑ ÑÐ¿ÐµÑÐ¸Ð°Ð»ÑÐ½Ð¾ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½Ð¾Ð¹ Ð¼Ð¾Ð´ÐµÐ»Ð¸, Ð¾Ð¿ÑÐµÐ´ÐµÐ»ÑÑÑÑÑ ÑÐ²ÑÐ·Ð¸ "Ð¸ÑÐ¿Ð¾Ð»ÑÐ·ÑÐµÑÑÑ Ð´Ð»Ñ" Ð¼ÐµÐ¶Ð´Ñ ÑÑÐ¸Ð¼Ð¸ ÑÑÑÐ½Ð¾ÑÑÑÐ¼Ð¸ Ð¸ Ð¾ÑÐ±Ð¸ÑÐ°ÑÑÑÑ Ð¿ÑÐ°ÐºÑÐ¸ÑÐµÑÐºÐ¸ Ð·Ð½Ð°ÑÐ¸Ð¼ÑÐµ Ð¿Ð°ÑÑ Ð¼ÐµÑÐ¾Ð´-Ð·Ð°Ð´Ð°ÑÐ°. ÐÐ»Ñ ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ ÑÐ¸ÑÑÐµÐ¼Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð»Ð¸ÑÑ Ð´Ð°Ð½Ð½ÑÐµ, Ð½Ðµ Ð²ÐºÐ»ÑÑÐµÐ½Ð½ÑÐµ Ð² ÑÑÐµÐ½Ð¸ÑÐ¾Ð²Ð¾ÑÐ½ÑÐ¹ Ð½Ð°Ð±Ð¾Ñ. ÐÑÐ¾Ð²ÐµÐ´ÑÐ½ t-ÑÐµÑÑ Ð´Ð»Ñ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° ÑÐ²ÑÐ·Ð¸ Ð¼ÐµÐ¶Ð´Ñ Ð¼ÐµÑÐ¾Ð´Ð°Ð¼Ð¸, Ð·Ð°Ð´Ð°ÑÐ°Ð¼Ð¸ Ð¸ Ð¸Ñ ÐºÐ¾Ð¼Ð±Ð¸Ð½Ð°ÑÐ¸ÐµÐ¹ Ñ Ð¿Ð¾ÐºÐ°Ð·Ð°ÑÐµÐ»ÐµÐ¼ Ð½Ð¾Ð²Ð¸Ð·Ð½Ñ. Ð ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐµ t-ÑÐµÑÑÐ° Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸ÐµÐ¼ Ð°Ð½Ð½Ð¾ÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð½ÑÑ Ð´Ð°Ð½Ð½ÑÑ Ð±ÑÐ»Ð¾ ÑÑÑÐ°Ð½Ð¾Ð²Ð»ÐµÐ½Ð¾, ÑÑÐ¾ "Ð¼ÐµÑÐ¾Ð´-Ð·Ð°Ð´Ð°ÑÐ°" ÐºÐ¾Ð¼Ð±Ð¸Ð½Ð°ÑÐ¸Ñ Ð·Ð½Ð°ÑÐ¸Ð¼Ð¾ ÐºÐ¾ÑÑÐµÐ»Ð¸ÑÑÐµÑ Ñ Ð¿Ð¾ÐºÐ°Ð·Ð°ÑÐµÐ»ÐµÐ¼ Ð½Ð¾Ð²Ð¸Ð·Ð½Ñ, ÑÑÐ¾ Ð¿Ð¾Ð´ÑÐ²ÐµÑÐ¶Ð´Ð°ÐµÑ Ð¿ÑÐ°Ð²Ð¸Ð»ÑÐ½Ð¾ÑÑÑ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð½ÑÑ Ð¼ÐµÑÐ¾Ð´Ð¾Ð² Ð¸ Ð¿ÑÐ¾ÑÐµÑÑÐ¾Ð² Ð² Ð´Ð°Ð½Ð½Ð¾Ð¼ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ð¸. Ð­ÑÐ¾Ñ ÑÐµÐ·ÑÐ»ÑÑÐ°Ñ ÑÐ°ÐºÐ¶Ðµ Ð¿Ð¾ÐºÐ°Ð·ÑÐ²Ð°ÐµÑ, ÑÑÐ¾ Ð¸Ð½Ð½Ð¾Ð²Ð°ÑÐ¸Ð¸ Ð² Ð½Ð°ÑÑÐ½ÑÑ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸ÑÑ ÑÐ°ÑÑÐ¾ Ð¿ÑÐ¾Ð¸ÑÑÐ¾Ð´ÑÑ Ð±Ð»Ð°Ð³Ð¾Ð´Ð°ÑÑ Ð½Ð¾Ð²ÑÐ¼ ÐºÐ¾Ð¼Ð±Ð¸Ð½Ð°ÑÐ¸ÑÐ¼ Ð¼ÐµÑÐ¾Ð´Ð¾Ð² Ð¸ Ð·Ð°Ð´Ð°Ñ. Ð ÐµÐ·ÑÐ»ÑÑÐ°ÑÑ Ð´Ð°Ð½Ð½Ð¾Ð³Ð¾ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ Ð¼Ð¾Ð³ÑÑ Ð±ÑÑÑ Ð¿ÑÐ¸Ð¼ÐµÐ½ÐµÐ½Ñ Ð´Ð»Ñ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ð½Ð¾Ð³Ð¾ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° Ð½Ð°ÑÑÐ½Ð¾Ð¹ Ð»Ð¸ÑÐµÑÐ°ÑÑÑÑ, Ð¿ÑÐµÐ´Ð¾ÑÑÐ°Ð²Ð»ÑÑ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°ÑÐµÐ»ÑÐ¼ ÑÐµÐ½Ð½ÑÐµ ÑÐµÐºÐ¾Ð¼ÐµÐ½Ð´Ð°ÑÐ¸Ð¸ Ð¿ÑÐ¸ Ð²ÑÐ±Ð¾ÑÐµ ÑÐµÐ¼ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ð¹ Ð¸ Ð¿Ð¾Ð²ÑÑÐ°Ñ ÑÑÑÐµÐºÑÐ¸Ð²Ð½Ð¾ÑÑÑ ÑÐ°Ð±Ð¾ÑÑ ÑÐµÑÐµÐ½Ð·ÐµÐ½ÑÐ¾Ð².
description: The given work is devoted to the development of an automated system based on deep learning and natural language processing for assessing the novelty of scien-tific and technical articles. The history of science and technology is full of signifi-cant breakthroughs and theoretical innovations, each contributing to the progress of humanity. Starting from the 19th century, as technologies rapidly developed, the number of publications in scientific literature also increased quickly, creating chal-lenges for traditional peer review processes. Novelty is a key criterion in the evaluation of articles. To address the prob-lem of novelty assessment, this study proposes a system that combines entity recognition, relationship extraction between entities, and novelty score calculation. The system uses advanced entity recognition technologies to process the titles and abstracts of the literature, accurately identifying entities such as "methods" and "tasks." Then, using a specially developed model, "used-for" relationships between these entities are determined, and practically significant method-task pairs are se-lected. To test the system, data not included in the training set were used. A t-test was conducted to analyze the relationship between methods, tasks, and their com-bination with the novelty score. As a result of the t-test using annotated data, it was established that the "method-task" combination significantly correlates with the novelty score, confirming the correctness of the methods and processes used in this study. This result also shows that innovations in scientific research often occur due to new combinations of methods and tasks. The results of this study can be applied to the automated analysis of scientific literature, providing researchers with valuable recommendations when choosing research topics and increasing the efficiency of reviewers work.