title: Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° ÑÐµÑÐ²Ð¸ÑÐ° Ð´Ð»Ñ Ð¾ÑÐµÐ½ÐºÐ¸ ÑÐ»Ð¾Ð¶Ð½Ð¾ÑÑÐ¸ Ð½Ð°ÑÑÐ½ÑÑ ÑÑÐ°ÑÐµÐ¹ Ð¸ Ð½Ð¾Ð²Ð¾ÑÑÐ½ÑÑ ÑÑÐ°ÑÐµÐ¹ ÑÐ°Ð·Ð½ÑÑ Ð²ÑÐ·Ð¾Ð² Ð Ð¤
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð±Ð°ÐºÐ°Ð»Ð°Ð²ÑÐ°
titleType: Subtitle
title: Development of a service for assessing the complexity of scientific articles and news articles of Russian universities
Creators: name: ÐÐ¾Ð´Ð°Ð½Ð¾Ð², ÐÐ°Ð½Ð¸Ð¸Ð»
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2023
Subjects: Ð¾ÑÐµÐ½ÐºÐ° ÑÐ»Ð¾Ð¶Ð½Ð¾ÑÑÐ¸ ÑÐµÐºÑÑÐ°
ÑÐ±Ð¾Ñ Ð´Ð°Ð½Ð½ÑÑ
Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð°ÑÐ¸Ñ ÑÐ±Ð¾ÑÐ° Ð´Ð°Ð½Ð½ÑÑ
ÑÐ´Ð¾Ð±Ð¾ÑÐ¸ÑÐ°ÐµÐ¼Ð¾ÑÑÑ ÑÐµÐºÑÑÐ°
text complexity assessment
data collection
data collection automation
text readability

description: Ð¢ÐµÐ¼Ð° Ð²ÑÐ¿ÑÑÐºÐ½Ð¾Ð¹ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÑ: Â«Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° ÑÐµÑÐ²Ð¸ÑÐ° Ð´Ð»Ñ Ð¾ÑÐµÐ½ÐºÐ¸ ÑÐ»Ð¾Ð¶Ð½Ð¾ÑÑÐ¸ Ð½Ð°ÑÑÐ½ÑÑ ÑÑÐ°ÑÐµÐ¹ Ð¸ Ð½Ð¾Ð²Ð¾ÑÑÐ½ÑÑ ÑÑÐ°ÑÐµÐ¹ Ð²ÑÐ·Ð¾Ð² Ð Ð¤Â». Ð¦ÐµÐ»Ñ ÑÐ°Ð±Ð¾ÑÑ - ÑÐ¾Ð·Ð´Ð°ÑÑ ÐºÐ¾ÑÐ¿ÑÑ Ð´Ð°Ð½Ð½ÑÑ Ð´Ð»Ñ ÑÐµÑÐ²Ð¸ÑÐ° Ð¾ÑÐµÐ½ÐºÐ¸ ÑÐ»Ð¾Ð¶Ð½Ð¾ÑÑÐ¸ ÑÑÐ°-ÑÐµÐ¹. ÐÐ»Ñ ÑÑÐ¾Ð³Ð¾ Ð¿Ð¾ÑÑÐ°Ð²Ð»ÐµÐ½Ñ ÑÐ»ÐµÐ´ÑÑÑÐ¸Ðµ Ð·Ð°Ð´Ð°ÑÐ¸: Ð¾Ð¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð¸Ðµ Ð¿Ð¾Ð´ÑÐ¾Ð´ÑÑÐ¸Ñ Ð¸ÑÑÐ¾ÑÐ½Ð¸ÐºÐ¾Ð², Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ð½ÑÐ¹ ÑÐ±Ð¾Ñ Ð´Ð°Ð½Ð½ÑÑ, ÐºÐ»Ð°ÑÑÐ¸ÑÐ¸ÐºÐ°ÑÐ¸Ñ Ð´Ð°Ð½Ð½ÑÑ, Ð° ÑÐ°ÐºÐ¶Ðµ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð¿ÑÐ¾ÑÐ¾ÑÐ¸Ð¿Ð° ÑÐµÑÐ²Ð¸ÑÐ°. ÐÑÐ»Ð¸ ÑÐ°ÑÑÐ¼Ð¾ÑÑÐµÐ½Ñ ÑÐ°Ð·Ð»Ð¸ÑÐ½ÑÐµ Ð¸ÑÑÐ¾ÑÐ½Ð¸ÐºÐ¸, Ð²ÐºÐ»ÑÑÐ°Ñ "ÐÐ¾Ð»Ð¸ÑÐµÑ ÐÐ°ÑÐºÐ° Ð¸ Ð¸Ð½-Ð½Ð¾Ð²Ð°ÑÐ¸Ð¸", "ÐÑÑÐ¸Ð² ÐÑÐ¾ÐµÐºÑÑ ÐÐ°Ð±Ð¾ÑÐ°ÑÐ¾ÑÐ¸Ñ ÐÐ¡ÐÐÐ" Ð¸ Ð½Ð¾Ð²Ð¾ÑÑÐ½ÑÐµ ÑÑÐ°ÑÑÐ¸ Ð¡ÐÐ±ÐÐ£ Ð¸Ð· ÑÐ°Ð·Ð´ÐµÐ»Ð° "ÐÐ°ÑÐºÐ° Ð¸ ÐÐ½Ð½Ð¾Ð²Ð°ÑÐ¸Ð¸". ÐÐ»Ñ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ð½Ð¾Ð³Ð¾ ÑÐ±Ð¾ÑÐ° Ð´Ð°Ð½Ð½ÑÑ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½ Ð¿ÑÐ¾ÑÐµÑÑ, Ð²ÐºÐ»ÑÑÐ°ÑÑÐ¸Ð¹ ÑÐ±Ð¾ÑÑÐ¸ÐºÐ¸ Ð´Ð°Ð½Ð½ÑÑ, ÑÐ¿ÐµÑÐ¸Ð°Ð»ÑÐ½Ð¾ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½ÑÐµ Ð´Ð»Ñ ÐºÐ°Ð¶Ð´Ð¾Ð³Ð¾ Ð¸ÑÑÐ¾ÑÐ½Ð¸ÐºÐ°. Ð¡Ð±Ð¾ÑÑÐ¸ÐºÐ¸ Ð¸Ð·Ð²Ð»ÐµÐºÐ°ÑÑ Ð½ÑÐ¶Ð½ÑÐµ Ð´Ð°Ð½Ð½ÑÐµ (Ð·Ð°Ð³Ð¾Ð»Ð¾Ð²ÐºÐ¸, ÑÑÑÐ»ÐºÐ¸, Ð¼ÐµÑÐ°Ð´Ð°Ð½Ð½ÑÐµ, ÑÐµÐºÑÑ ÑÑÐ°ÑÐµÐ¹) Ð¸ ÑÐ¾ÑÑÐ°Ð½ÑÑÑ Ð¸Ñ ÑÑÑÑÐºÑÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð½Ð¾. Ð ÐµÐ°Ð»Ð¸Ð·Ð¾Ð²Ð°Ð½Ð° Ð¾ÑÐºÐ°Ð·Ð¾ÑÑÑÐ¾Ð¹ÑÐ¸Ð²Ð°Ñ Ð°ÑÑÐ¸ÑÐµÐºÑÑÑÐ° Ñ Ð¿Ð»Ð°Ð½Ð¸ÑÐ¾Ð²ÑÐ¸ÐºÐ¾Ð¼ Ð·Ð°Ð´Ð°Ñ. Ð¢Ð°Ðº-Ð¶Ðµ ÑÐµÑÐµÐ½Ð° Ð·Ð°Ð´Ð°ÑÐ° ÐºÐ»Ð°ÑÑÐ¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¸ Ð´Ð°Ð½Ð½ÑÑ, ÐºÐ¾ÑÐ¾ÑÐ°Ñ Ð¿Ð¾Ð¼Ð¾Ð³Ð°ÐµÑ Ð¾ÑÐ´ÐµÐ»Ð¸ÑÑ ÑÑÐ°ÑÑÐ¸ Ð¿Ð¾ Ð¸Ñ ÑÐ»Ð¾Ð¶Ð½Ð¾ÑÑÐ¸. ÐÐ»Ð³Ð¾ÑÐ¸ÑÐ¼ Ð¾ÑÐ½Ð¾Ð²Ð°Ð½ Ð½Ð° ÑÑÑÐµÑÑÐ²ÑÑÑÐ¸Ñ Ð¼ÐµÑÑÐ¸ÐºÐ°Ñ Ð¸ Ð¸Ð½ÑÐµÐ³ÑÐ¸ÑÐ¾Ð²Ð°Ð½ Ð² Ð¿ÑÐ¾ÑÐ¾ÑÐ¸Ð¿ ÑÐµÑÐ²Ð¸ÑÐ°. Ð ÐµÐ·ÑÐ»ÑÑÐ°ÑÑ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ Ð¿Ð¾ÐºÐ°Ð·ÑÐ²Ð°ÑÑ ÑÑÐ¿ÐµÑÐ½Ð¾ÑÑÑ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ð½Ð¾-Ð³Ð¾ ÑÐ±Ð¾ÑÐ° Ð´Ð°Ð½Ð½ÑÑ. Ð¡Ð¾Ð±ÑÐ°Ð½Ð½ÑÐµ Ð´Ð°Ð½Ð½ÑÐµ Ð¾ÑÑÐ°Ð¶Ð°ÑÑ Ð¾ÑÐ½Ð¾Ð²Ð½ÑÑ ÑÐµÐ»ÐµÐ²ÑÑ Ð°ÑÐ´Ð¸ÑÐ¾ÑÐ¸Ñ ÑÑÐ°ÑÐµÐ¹, ÑÐ¾ÑÑÐ¾ÑÑÑÑ Ð¸Ð· ÑÑÑÐ´ÐµÐ½ÑÐ¾Ð² ÑÑÐ°ÑÑÐ¸Ñ ÐºÑÑÑÐ¾Ð². Ð¢Ð°ÐºÐ¸Ð¼ Ð¾Ð±ÑÐ°Ð·Ð¾Ð¼, ÐºÐ¾Ð½ÑÐµÐ½Ñ ÑÐµÑ-Ð²Ð¸ÑÐ° Ð±Ð¾Ð»ÑÑÐµ Ð¿Ð¾Ð´ÑÐ¾Ð´Ð¸Ñ Ð´Ð»Ñ Ð»ÑÐ´ÐµÐ¹ Ñ Ð±Ð¾Ð»ÐµÐµ Ð²ÑÑÐ¾ÐºÐ¸Ð¼ ÑÑÐ¾Ð²Ð½ÐµÐ¼ ÐºÐ¾Ð¼Ð¿ÐµÑÐµÐ½ÑÐ¸Ð¸. ÐÐ°Ð¶Ð½Ð¾ Ð¾Ð±ÑÐ°ÑÐ¸ÑÑ Ð²Ð½Ð¸Ð¼Ð°Ð½Ð¸Ðµ Ð°Ð²ÑÐ¾ÑÐ¾Ð² Ð¸ÑÑÐ¾ÑÐ½Ð¸ÐºÐ¾Ð² Ð½Ð° ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÑ Ð¼Ð°ÑÐµÑÐ¸Ð°Ð»Ð¾Ð² Ð´Ð»Ñ Ð½Ð°ÑÐ¸Ð½Ð°ÑÑÐ¸Ñ ÑÑÑÐ´ÐµÐ½ÑÐ¾Ð². Ð­ÑÐ¾ ÑÐ¿Ð¾ÑÐ¾Ð±ÑÑÐ²ÑÐµÑ Ð¿ÑÐ¸Ð²Ð»ÐµÑÐµÐ½Ð¸Ñ Ð½Ð¾Ð²ÑÑ Ð»ÑÐ´ÐµÐ¹ Ð² Ð½Ð°ÑÐºÑ Ð¸ Ð¼Ð¾-Ð¶ÐµÑ Ð·Ð°Ð¸Ð½ÑÐµÑÐµÑÐ¾Ð²Ð°ÑÑ Ð¼Ð¾Ð»Ð¾Ð´ÐµÐ¶Ñ Ð² Ð¸Ð·ÑÑÐµÐ½Ð¸Ð¸ Ð½Ð°ÑÑÐ½ÑÑ Ð´Ð¸ÑÑÐ¸Ð¿Ð»Ð¸Ð½. Ð ÐµÐ·ÑÐ»ÑÑÐ°ÑÑ ÑÐ±Ð¾ÑÐ° Ð´Ð°Ð½Ð½ÑÑ ÑÐ²Ð»ÑÑÑÑÑ ÑÐµÐ½Ð½ÑÐ¼ Ð²ÐºÐ»Ð°Ð´Ð¾Ð¼ Ð² Ð´Ð°Ð»ÑÐ½ÐµÐ¹ÑÐµÐµ ÑÐ°Ð·Ð²Ð¸ÑÐ¸Ðµ ÑÐµÑÐ²Ð¸ÑÐ°. ÐÐ½Ð¸ Ð±ÑÐ´ÑÑ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ñ Ð´Ð»Ñ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° Ð¸ ÑÐ»ÑÑÑÐµÐ½Ð¸Ñ ÐºÐ°ÑÐµÑÑÐ²Ð° Ð¾Ð¿ÑÐµ-Ð´ÐµÐ»ÐµÐ½Ð¸Ñ ÑÑÐ¾Ð²Ð½Ñ ÑÐ»Ð¾Ð¶Ð½Ð¾ÑÑÐ¸ ÑÑÐ°ÑÐµÐ¹.
description: Topic of the graduation qualification work: Â«Development of a service for assessing the complexity of scientific articles and news articles of Russian universitiesÂ» The aim of the work is to create a data corpus for the article complexity assessment service. To achieve this, the following tasks were set: identification of suitable sources, automated data collection, data classification, and development of a service prototype. Various sources were considered, including "Polytech Science and Innova-tion," "Archive Projects Laboratory PSPOD," and news articles from SPbPUs "Science and Innovation" section. For automated data collection, a process was developed, including data crawlers specifically designed for each source. The crawlers extract relevant data (headings, links, metadata, article text) and store them in a structured manner. A fault-tolerant architecture with a task scheduler has been implemented. The task of data classification has also been solved, which helps differentiate articles based on their complexity. The algorithm is based on existing metrics and integrated into the service prototype. The research results demonstrate the success of automated data collection. The collected data reflect the main target audience of the articles, consisting of senior students. Thus, the content of the service is more suitable for individuals with a higher level of competence. It is important to draw the attention of source authors to the development of materials for beginner students. This contributes to attracting new people to science and may interest young people in studying scientific disciplines. The data collection results are a valuable contribution to the further development of the service. They will be used for analysis and improvement of the qual-ity of article complexity determination.