title: Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð¼Ð¾Ð´ÑÐ»Ñ Ð´Ð»Ñ Ð³ÑÑÐ¿Ð¿Ð¸ÑÐ¾Ð²ÐºÐ¸ Ð½Ð¾Ð²Ð¾ÑÑÐ½ÑÑ ÑÑÐ°ÑÐµÐ¹
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð±Ð°ÐºÐ°Ð»Ð°Ð²ÑÐ°
titleType: Subtitle
title: Development of a module for grouping news articles
Creators: name: ÐÐ³Ð°ÐµÐ², ÐÑÐ»Ð°Ð½
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2020
Subjects: Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ° ÐµÑÑÐµÑÑÐ²ÐµÐ½Ð½Ð¾Ð³Ð¾ ÑÐ·ÑÐºÐ°
Ð¸Ð·Ð²Ð»ÐµÑÐµÐ½Ð¸Ðµ ÐºÐ»ÑÑÐµÐ²ÑÑ ÑÐ»Ð¾Ð²Ð¾ÑÐ¾ÑÐµÑÐ°Ð½Ð¸Ð¹
Ð¸Ð·Ð²Ð»ÐµÑÐµÐ½Ð¸Ðµ Ð¸Ð¼ÐµÐ½Ð¾Ð²Ð°Ð½Ð½ÑÑ ÑÑÑÐ½Ð¾ÑÑÐµÐ¹
ÑÐ°ÑÑÐµÑÐµÑÐ½Ð°Ñ ÑÐ°Ð·Ð¼ÐµÑÐºÐ°
ÐºÐ»Ð°ÑÑÐµÑÐ¸Ð·Ð°ÑÐ¸Ñ
natural language processing
key phrases extraction
named entities extraction
part of speech tagging
clusterization

description: Ð¢ÐµÐ¼Ð° Ð²ÑÐ¿ÑÑÐºÐ½Ð¾Ð¹ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÑ: Â«Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ°
Ð¼Ð¾Ð´ÑÐ»Ñ Ð´Ð»Ñ Ð³ÑÑÐ¿Ð¿Ð¸ÑÐ¾Ð²ÐºÐ¸ Ð½Ð¾Ð²Ð¾ÑÑÐ½ÑÑ ÑÑÐ°ÑÐµÐ¹Â».
ÐÐ°Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¿Ð¾ÑÐ²ÑÑÐµÐ½Ð° Ð¸Ð·Ð²Ð»ÐµÑÐµÐ½Ð¸Ñ ÐºÐ»ÑÑÐµÐ²ÑÑ ÑÐ»Ð¾Ð²Ð¾ÑÐ¾ÑÐµÑÐ°Ð½Ð¸Ð¹ Ð¸ Ð³ÑÑÐ¿Ð¿Ð¸ÑÐ¾Ð²ÐºÐµ Ð½Ð¾Ð²Ð¾ÑÑÐ½ÑÑ ÑÑÐ°ÑÐµÐ¹ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð¸Ñ Ð°Ð½Ð°Ð»Ð¸Ð·Ð°.
ÐÐ°Ð´Ð°ÑÐ¸, ÐºÐ¾ÑÐ¾ÑÑÐµ ÑÐµÑÐ°Ð»Ð¸ÑÑ Ð² ÑÐ¾Ð´Ðµ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ:
1. Ð ÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ Ð¼ÐµÑÐ¾Ð´Ð° Ð¸Ð·Ð²Ð»ÐµÑÐµÐ½Ð¸Ñ Ð¸Ð¼ÐµÐ½Ð¾Ð²Ð°Ð½Ð½ÑÑ ÑÑÑÐ½Ð¾ÑÑÐµÐ¹ Ð¸Ð· ÑÐµÐºÑÑÐ¾Ð² Ð½Ð¾Ð²Ð¾ÑÑÐ½ÑÑ ÑÑÐ°ÑÐµÐ¹.
2. Ð ÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ Ð¼ÐµÑÐ¾Ð´Ð° Ð¸Ð·Ð²Ð»ÐµÑÐµÐ½Ð¸Ñ ÐºÐ»ÑÑÐµÐ²ÑÑ ÑÐ»Ð¾Ð²Ð¾ÑÐ¾ÑÐµÑÐ°Ð½Ð¸Ð¹ Ð¸Ð· ÑÐµÐºÑÑÐ¾Ð² ÑÑÐ°ÑÐµÐ¹.
3. Ð ÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð° Ð³ÑÑÐ¿Ð¿Ð¸ÑÐ¾Ð²ÐºÐ¸ Ð½Ð¾Ð²Ð¾ÑÑÐ½ÑÑ ÑÑÐ°ÑÐµÐ¹ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ð°Ð½Ð¸Ð¸ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° ÐºÐ»ÑÑÐµÐ²ÑÑ ÑÐ»Ð¾Ð²Ð¾ÑÐ¾ÑÐµÑÐ°Ð½Ð¸Ð¹.
4. Ð ÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ Ð¸Ð½ÑÐµÑÑÐµÐ¹ÑÐ° Ð´Ð»Ñ ÐºÐ¾ÑÑÐµÐºÑÐ¸ÑÐ¾Ð²ÐºÐ¸ ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐ¾Ð² ÑÐ°Ð±Ð¾ÑÑ Ð¼Ð¾Ð´ÑÐ»Ñ.
Ð Ð°Ð±Ð¾ÑÐ° Ð¿ÑÐ¾Ð²ÐµÐ´ÐµÐ½Ð° Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð±Ð°Ð·Ñ Ð´Ð°Ð½Ð½ÑÑ Ð°Ð³ÑÐµÐ³Ð°ÑÐ¾ÑÐ° Ð½Ð¾Ð²Ð¾ÑÑÐµÐ¹ OnoMediaScope. ÐÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ñ Ð½Ð¾Ð²Ð¾ÑÑÐ½ÑÐµ ÑÑÐ°ÑÑÐ¸, ÐºÐ»Ð°ÑÑÐµÑÐ¸Ð·Ð¾Ð²Ð°Ð½Ð½ÑÐµ Ð¿Ð¾ ÑÐµÐ¼Ð°Ð¼. Ð ÑÐ°Ð±Ð¾ÑÐµ Ð¾Ð¿Ð¸ÑÐ°Ð½ Ð¼Ð¾Ð´ÑÐ»Ñ Ð´Ð»Ñ Ð³ÑÑÐ¿Ð¿Ð¸ÑÐ¾Ð²ÐºÐ¸ Ð½Ð¾Ð²Ð¾ÑÑÐ½ÑÑ ÑÑÐ°ÑÐµÐ¹ Ð½Ð° Ð¾Ð´Ð½Ñ Ð¸ ÑÑ Ð¶Ðµ Ð¸Ð»Ð¸ ÑÐ¼ÐµÐ¶Ð½ÑÐµ ÑÐµÐ¼Ñ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ð°-
Ð½Ð¸Ð¸ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° ÐºÐ»ÑÑÐµÐ²ÑÑ ÑÐ»Ð¾Ð²Ð¾ÑÐ¾ÑÐµÑÐ°Ð½Ð¸Ð¹. ÐÐ»Ñ Ð²ÑÐ´ÐµÐ»ÐµÐ½Ð¸Ñ ÐºÐ»ÑÑÐµÐ²ÑÑ ÑÐ»Ð¾Ð²Ð¾ÑÐ¾ÑÐµÑÐ°Ð½Ð¸Ð¹ Ð¿ÑÐ¾Ð²ÐµÐ´ÐµÐ½ ÑÐ°ÑÑÐ¾ÑÐ½ÑÐ¹ Ð°Ð½Ð°Ð»Ð¸Ð· Ð¸ÑÐ¿Ð¾Ð»ÑÐ·ÑÐµÐ¼ÑÑ ÑÐ»Ð¾Ð², Ð¿Ð¾ÑÑÑÐ¾ÐµÐ½Ð¾ Ð´ÐµÑÐµÐ²Ð¾ Ð·Ð°Ð²Ð¸ÑÐ¸Ð¼Ð¾ÑÑÐµÐ¹, Ð¿ÑÐ¾Ð¸Ð·Ð²ÐµÐ´ÐµÐ½Ð¾ Ð¸Ð·Ð²Ð»ÐµÑÐµÐ½Ð¸Ðµ Ð¸Ð¼ÐµÐ½Ð¾Ð²Ð°Ð½Ð½ÑÑ ÑÑÑÐ½Ð¾ÑÑÐµÐ¹. ÐÑÐ¾Ð²ÐµÑÐµÐ½Ñ Ð³Ð¸Ð¿Ð¾ÑÐµÐ·Ñ Ð¾ Ð²Ð°Ð¶Ð½Ð¾ÑÑÐ¸
Ð³Ð»Ð°Ð³Ð¾Ð»ÑÐ½ÑÑ ÑÐ¾ÑÐ¼, ÑÑÑÐµÑÑÐ²Ð¸ÑÐµÐ»ÑÐ½ÑÑ Ð² ÑÐ¾Ð´Ð¸ÑÐµÐ»ÑÐ½Ð¾Ð¼ Ð¸ Ð¿ÑÐµÐ´Ð»Ð¾Ð¶Ð½Ð¾Ð¼ Ð¿Ð°Ð´ÐµÐ¶Ð°Ñ. ÐÑÐ¾Ð¸Ð·Ð²ÐµÐ´ÐµÐ½Ð° Ð³ÑÑÐ¿Ð¿Ð¸ÑÐ¾Ð²ÐºÐ° Ð½Ð¾Ð²Ð¾ÑÑÐ½ÑÑ ÑÑÐ°ÑÐµÐ¹.
description: Theme of the final qualification work: âA module for grouping news articles based on the analysis of key phrasesâ.
This work is devoted to extracting key phrases and grouping news articles. Tasks that were solved: 
1. Implementation of a method for extracting named entities from news articles.
2. Implementation of a method for extracting key phrases from article texts.
3. Implementation of the algorithm for grouping news articles based on the analysis of key phrases.
4. Implementation of the interface for adjusting the results of the module.
The work was carried out on the basis of the OnoMediaScope news aggregator database. News articles clustered by topic were used. The paper describes a module for grouping news articles on the same or related topics based on the analysis of key phrases. To
extract key phrases, a frequency analysis of words was carried out, a dependency tree was built and named entities were extracted. The hypotheses on the importance of verb forms and nouns in the genitive and prepositional cases were tested. News articles were grouped.