title: Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð¾Ð³Ð¾ Ð¸Ð½ÑÑÑÑÐ¼ÐµÐ½ÑÐ° Ð´Ð»Ñ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ð½Ð¾Ð³Ð¾ ÑÐ±Ð¾ÑÐ° Ð¸Ð½ÑÐ¾ÑÐ¼Ð°ÑÐ¸Ð¸ Ð² ÑÐµÑÐ¸ "ÐÐ½ÑÐµÑÐ½ÐµÑ" Ð¿ÑÐ¸ Ð¿Ð¾Ð´Ð³Ð¾ÑÐ¾Ð²ÐºÐµ Ð´Ð°ÑÐ°ÑÐµÑÐ¾Ð² Ð´Ð»Ñ Ð½Ð°ÑÑÐ½ÑÑ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ð¹
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¼Ð°Ð³Ð¸ÑÑÑÐ°
titleType: Subtitle
title: Development of a software tool for collecting information on the Internet when preparing datasets for scientific research
Creators: name: Ð¨ÐµÐ¼ÐµÑÐ¾Ð², Ð¡ÑÐµÐ¿Ð°Ð½
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2024
Subjects: Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð°ÑÐ¸Ñ
Ð°Ð½Ð°Ð»Ð¸Ð· Ð½Ð°ÑÑÐ½ÑÑ ÑÐ°Ð±Ð¾Ñ
Ð¿Ð°ÑÑÐ¸Ð½Ð³ Ð´Ð°Ð½Ð½ÑÑ
Ð²ÐµÐ±-ÑÐºÑÐ°Ð¿ÐµÑ
automation
analysis of scientific works
data parsing
web scraper

description: ÐÐ°Ð³Ð¸ÑÑÐµÑÑÐºÐ°Ñ Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¿Ð¾ÑÐ²ÑÑÐµÐ½Ð° Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð°ÑÐ¸Ð¸ ÑÐ±Ð¾ÑÐ° Ð¸ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° Ð½Ð°ÑÑÐ½ÑÑ ÑÑÐ°ÑÐµÐ¹ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð´Ð°Ð½Ð½ÑÑ Ð¸Ð· Ð²Ð½ÐµÑÐ½Ð¸Ñ Ð¸ÑÑÐ¾ÑÐ½Ð¸ÐºÐ¾Ð². ÐÐ°Ð´Ð°ÑÐ¸ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ Ð²ÐºÐ»ÑÑÐ°Ð»Ð¸ Ð² ÑÐµÐ±Ñ ÑÐ»ÐµÐ´ÑÑÑÐµÐµ. 1. ÐÑÐ¾Ð²ÐµÐ´ÐµÐ½Ð¸Ðµ Ð¾Ð±Ð·Ð¾ÑÐ° Ð¸ ÑÑÐ°Ð²Ð½ÐµÐ½Ð¸Ðµ Ð¸Ð½ÑÑÑÑÐ¼ÐµÐ½ÑÐ¾Ð² Ð²ÐµÐ±-ÑÐºÑÐ°Ð¿Ð¸Ð½Ð³Ð°, Ñ ÑÐµÐ»ÑÑ Ð²ÑÑÐ²Ð»ÐµÐ½Ð¸Ñ Ð¸Ñ Ð¿Ð»ÑÑÐ¾Ð² Ð¸ Ð¼Ð¸Ð½ÑÑÐ¾Ð² Ð¸ Ð¾ÑÐ½Ð¾Ð²Ð½ÑÑ ÑÑÐ½ÐºÑÐ¸Ð¾Ð½Ð°Ð»ÑÐ½ÑÑ Ð²Ð¾Ð·Ð¼Ð¾Ð¶Ð½Ð¾ÑÑÐµÐ¹. 2. Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ð½Ð¾Ð³Ð¾ ÑÐ±Ð¾ÑÐ° Ð¸ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° Ð´Ð°Ð½Ð½ÑÑ. 3. Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð²ÐµÐ±-ÑÐºÑÐ°Ð¿ÐµÑÐ° Ð´Ð»Ñ ÑÐ±Ð¾ÑÐ° Ð¸ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° Ð´Ð°Ð½Ð½ÑÑ Ð½Ð°ÑÑÐ½ÑÑ ÑÐ°Ð±Ð¾Ñ. 4. Ð¢ÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ðµ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½Ð¾Ð³Ð¾ ÑÐµÑÐ²Ð¸ÑÐ° Ð¸ Ð¾ÑÐµÐ½ÐºÐ° ÐµÐ³Ð¾ ÑÑÑÐµÐºÑÐ¸Ð²Ð½Ð¾ÑÑÐ¸. Ð ÑÐ°Ð¼ÐºÐ°Ñ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ Ð±ÑÐ» Ð¿ÑÐµÐ´Ð»Ð¾Ð¶ÐµÐ½ Ð¼ÐµÑÐ¾Ð´ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ð½Ð¾Ð³Ð¾ ÑÐ±Ð¾ÑÐ° Ð¸ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° Ð´Ð°Ð½Ð½ÑÑ, ÐºÐ¾ÑÐ¾ÑÑÐ¹ Ð¾ÑÐ½Ð¾Ð²Ð°Ð½ Ð½Ð° Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸Ð¸ ÑÐ¿ÐµÑÐ¸Ð°Ð»Ð¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ð½Ð¾Ð³Ð¾ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð¾Ð³Ð¾ Ð¾Ð±ÐµÑÐ¿ÐµÑÐµÐ½Ð¸Ñ Ð´Ð»Ñ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸ÑÐµÑÐºÐ¾Ð³Ð¾ Ð¸Ð·Ð²Ð»ÐµÑÐµÐ½Ð¸Ñ Ð¸Ð½ÑÐ¾ÑÐ¼Ð°ÑÐ¸Ð¸ Ñ Ð²ÐµÐ±-ÑÑÑÐ°Ð½Ð¸Ñ Ð¸ ÑÐ¾Ð·Ð´Ð°Ð½Ð¸Ñ Ð¾ÑÑÐµÑÐ° Ð½Ð° ÐµÐ³Ð¾ Ð¾ÑÐ½Ð¾Ð²Ðµ. Ð ÑÐ¾Ð´Ðµ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ Ð±ÑÐ» ÑÑÐ¿ÐµÑÐ½Ð¾ ÑÐµÐ°Ð»Ð¸Ð·Ð¾Ð²Ð°Ð½ Ð¸ Ð¿ÑÐ¾ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½ Ð¿ÑÐµÐ´Ð»Ð¾Ð¶ÐµÐ½Ð½ÑÐ¹ Ð¼ÐµÑÐ¾Ð´. Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½ÑÐ¹ Ð¸Ð½ÑÑÑÑÐ¼ÐµÐ½Ñ ÑÑÑÐµÑÑÐ²ÐµÐ½Ð½Ð¾ ÑÐ¼ÐµÐ½ÑÑÐ¸Ð» Ð½ÐµÐ¾Ð±ÑÐ¾Ð´Ð¸Ð¼Ð¾Ðµ Ð²ÑÐµÐ¼Ñ Ð¸ ÑÑÐ¸Ð»Ð¸Ñ Ð½Ð° ÑÑÐ°Ð¿Ð°Ñ ÑÐ±Ð¾ÑÐ° Ð¸ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° Ð´Ð°Ð½Ð½ÑÑ, ÑÑÐ¾ ÑÑÐ°Ð» Ð·Ð½Ð°ÑÐ¸ÑÐµÐ»ÑÐ½ÑÐ¼ Ð¿ÑÐ¾Ð³ÑÐµÑÑÐ¾Ð¼ Ð² Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð°ÑÐ¸Ð¸ Ð¸ ÑÐ»ÑÑÑÐµÐ½Ð¸Ð¸ Ð¾Ð¿ÑÐ¸Ð¼Ð¸Ð·Ð°ÑÐ¸Ð¸ Ð½Ð°ÑÑÐ½ÑÑ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ð¹. Ð ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐµ ÑÐ°Ð±Ð¾ÑÑ Ð±ÑÐ»Ð¸ Ð¿ÑÐµÐ´ÑÑÐ°Ð²Ð»ÐµÐ½Ñ Ð¿ÑÐ¾ÑÑÑÐµ Ð¿ÑÐ¸Ð¼ÐµÑÑ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸Ñ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð¾Ð³Ð¾ ÑÑÐµÐ´ÑÑÐ²Ð°, Ð° ÑÐ°ÐºÐ¶Ðµ Ð¿ÑÐ¾Ð²ÐµÐ´ÐµÐ½ Ð°Ð½Ð°Ð»Ð¸Ð· Ð½Ð°ÑÑÐ½ÑÑ ÑÑÐ°ÑÐµÐ¹ Ñ ÐµÐ³Ð¾ Ð¿Ð¾Ð¼Ð¾ÑÑÑ. ÐÑÐ²ÐµÐ´ÐµÐ½Ñ Ð¿ÑÐµÐ¸Ð¼ÑÑÐµÑÑÐ²Ð° ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½Ð¾Ð³Ð¾ Ð¿ÑÐ¾Ð´ÑÐºÑÐ°, ÐºÐ¾ÑÐ¾ÑÑÐµ ÑÐ¿Ð¾ÑÐ¾Ð±ÑÑÐ²Ð¾Ð²Ð°Ð»Ð¸ Ð¿Ð¾Ð²ÑÑÐµÐ½Ð¸Ñ ÑÐºÐ¾ÑÐ¾ÑÑÐ¸ Ð¸ ÐºÐ°ÑÐµÑÑÐ²Ð° Ð¿ÑÐ¾ÑÐµÑÑÐ° ÑÐ±Ð¾ÑÐ° Ð¸ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° Ð´Ð°Ð½Ð½ÑÑ Ð² Ð½Ð°ÑÑÐ½ÑÑ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸ÑÑ.
description: The masters final qualifying thesis is devoted to the study of automation of collection and analysis of scientific articles based on data from external sources. The tasks of studying the features in themselves are as follows. 1. Review and compare web scraping tools in order to identify their pros and cons, as well as the main possible features. 2. Development of algorithms for automated data collection and analysis. 3. Development of a web scraper for collecting and analyzing data from scientific works. 4. Testing the developed service and assessing its effectiveness. As part of the study, a method of automated data collection and analysis was proposed, which is based on the use of specialized software to automatically extract information from web pages and create a report based on it. During the study, the proposed method was successfully implemented and tested. The developed tool significantly reduced the required time and effort during the data collection and analysis stages, which was a significant advance in automation and improved optimization of scientific research. As a result of the work, simple examples of using the software were presented, as well as an analysis of scientific articles using it. The advantages of the developed product are derived, which contributed to increasing the speed and quality of the process of collecting and analyzing data in scientific research.