title: Ð¡Ð¾Ð·Ð´Ð°Ð½Ð¸Ðµ ÑÐ°ÑÐ¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ ÑÐ±Ð¾ÑÐ°, Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ Ð¸ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° Ð³ÐµÐ¾Ð¿ÑÐ¾ÑÑÑÐ°Ð½ÑÑÐ²ÐµÐ½Ð½ÑÑ Ð´Ð°Ð½Ð½ÑÑ Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸ÐµÐ¼ ÑÐµÑ Ð½Ð¾Ð»Ð¾Ð³Ð¸Ð¹ Ð¸Ð½ÑÐµÐ³ÑÐ°ÑÐ¸Ð¸ Ð´Ð°Ð½Ð½ÑÑ
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¼Ð°Ð³Ð¸ÑÑÑÐ°
titleType: Subtitle
title: Creation of a distributed system for collecting, processing and analyzing geospatial data using data integration technologies
Creators: name: ÐÑÑÐ°ÑÐºÐ¸Ð½Ð°, ÐÐ°ÑÐ¸Ñ
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2024
Subjects: ÐÐ°Ð·Ñ Ð´Ð°Ð½Ð½ÑÑ
ÐÑÑÐ¸ÑÐ»Ð¸ÑÐµÐ»ÑÐ½ÑÐµ Ð¼Ð°ÑÐ¸Ð½Ñ ÑÐ»ÐµÐºÑÑÐ¾Ð½Ð½ÑÐµ Ð¿ÐµÑÑÐ¾Ð½Ð°Ð»ÑÐ½ÑÐµ
ÑÐµÑ Ð½Ð¾Ð»Ð¾Ð³Ð¸Ð¸ Ð¸Ð½ÑÐµÐ³ÑÐ°ÑÐ¸Ð¸ Ð´Ð°Ð½Ð½ÑÑ
Ð³ÐµÐ¾Ð¿ÑÐ¾ÑÑÑÐ°Ð½ÑÑÐ²ÐµÐ½Ð½ÑÐµ Ð´Ð°Ð½Ð½ÑÐµ
Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ° Ð´Ð°Ð½Ð½ÑÑ
data integration technologies
geospatial data
data processing

description: ÐÐ±ÑÐµÐºÑÐ¾Ð¼ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ ÑÐ²Ð»ÑÐµÑÑÑ Ð¾Ð±Ð»Ð°ÑÑÑ Ð¸Ð½ÑÐµÐ³ÑÐ°ÑÐ¸Ð¸ Ð´Ð°Ð½Ð½ÑÑ. ÐÑÐµÐ´Ð¼ÐµÑ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ - ÑÐ°ÑÐ¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð½Ð°Ñ ÑÐ¸ÑÑÐµÐ¼Ð° ÑÐ±Ð¾ÑÐ°, Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ Ð¸ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° Ð³ÐµÐ¾Ð¿ÑÐ¾ÑÑÑÐ°Ð½ÑÑÐ²ÐµÐ½Ð½ÑÑ Ð´Ð°Ð½Ð½ÑÑ. Ð¦ÐµÐ»ÑÑ Ð´Ð°Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÑ ÑÐ²Ð»ÑÐµÑÑÑ ÑÐ¾Ð·Ð´Ð°Ð½Ð¸Ðµ ÑÐ°ÑÐ¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ, ÑÐ¿Ð¾ÑÐ¾Ð±Ð½Ð¾Ð¹ ÑÑÑÐµÐºÑÐ¸Ð²Ð½Ð¾ ÑÐ¾Ð±Ð¸ÑÐ°ÑÑ, Ð¾Ð±ÑÐ°Ð±Ð°ÑÑÐ²Ð°ÑÑ Ð¸ Ð°Ð½Ð°Ð»Ð¸Ð·Ð¸ÑÐ¾Ð²Ð°ÑÑ Ð³ÐµÐ¾Ð¿ÑÐ¾ÑÑÑÐ°Ð½ÑÑÐ²ÐµÐ½Ð½ÑÐµ Ð´Ð°Ð½Ð½ÑÐµ Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸ÐµÐ¼ Ð¿ÐµÑÐµÐ´Ð¾Ð²ÑÑ ÑÐµÑÐ½Ð¾Ð»Ð¾Ð³Ð¸Ð¹ Ð¸Ð½ÑÐµÐ³ÑÐ°ÑÐ¸Ð¸ Ð´Ð°Ð½Ð½ÑÑ. ÐÐ°Ð´Ð°ÑÐ¸, ÐºÐ¾ÑÐ¾ÑÑÐµ ÑÐµÑÐ°Ð»Ð¸ÑÑ Ð² ÑÐ¾Ð´Ðµ Ð²ÑÐ¿Ð¾Ð»Ð½ÐµÐ½Ð¸Ñ ÑÐ°Ð±Ð¾ÑÑ: â Ð£ÑÑÐ°Ð½Ð¾Ð²Ð¸ÑÑ ÑÑÐµÐ±Ð¾Ð²Ð°Ð½Ð¸Ñ Ðº ÑÐ¾Ð·Ð´Ð°Ð²Ð°ÐµÐ¼Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ðµ Ð¸ Ð²ÑÐ¿Ð¾Ð»Ð½Ð¸ÑÑ Ð¾Ð±Ð·Ð¾Ñ Ð¿ÑÐµÐ´Ð¼ÐµÑÐ½Ð¾Ð¹ Ð¾Ð±Ð»Ð°ÑÑÐ¸. â ÐÑÐ±ÑÐ°ÑÑ Ð¸Ð½ÑÑÑÑÐ¼ÐµÐ½Ñ Ð¸Ð½ÑÐµÐ³ÑÐ°ÑÐ¸Ð¸ Ð´Ð°Ð½Ð½ÑÑ Ð´Ð»Ñ ÑÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ð¸ ÑÐ¸ÑÑÐµÐ¼Ñ. â Ð ÐµÐ°Ð»Ð¸Ð·Ð¾Ð²Ð°ÑÑ ÑÐ°ÑÐ¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð½ÑÑ ÑÐ¸ÑÑÐµÐ¼Ñ ÑÐ±Ð¾ÑÐ°, Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ Ð¸ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° Ð³ÐµÐ¾Ð¿ÑÐ¾ÑÑÑÐ°Ð½ÑÐ²ÑÐµÐ½Ð½ÑÑ Ð´Ð°Ð½Ð½ÑÑ Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸ÐµÐ¼ Ð²ÑÐ±ÑÐ°Ð½Ð½Ð¾Ð³Ð¾ Ð¸Ð½ÑÑÑÑÐ¼ÐµÐ½ÑÐ°. â ÐÑÐ¾Ð²ÐµÑÑÐ¸ ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ðµ Ð¸ Ð°Ð¿ÑÐ¾Ð±Ð°ÑÐ¸Ñ ÑÐµÐ°Ð»Ð¸Ð·Ð¾Ð²Ð°Ð½Ð½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ. ÐÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð»Ð¸ÑÑ Ð¼ÐµÑÐ¾Ð´Ñ ÑÑÐ°Ð²Ð½Ð¸ÑÐµÐ»ÑÐ½Ð¾Ð³Ð¾ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° ÑÐ°Ð·Ð»Ð¸ÑÐ½ÑÑ Ð¸Ð½ÑÑÑÑÐ¼ÐµÐ½ÑÐ¾Ð² Ð¸Ð½ÑÐµÐ³ÑÐ°ÑÐ¸Ð¸ Ð´Ð°Ð½Ð½ÑÑ, Ð° ÑÐ°Ðº Ð¶Ðµ Ð¿Ð¾Ð»ÐµÐ²Ð¾Ð³Ð¾ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ. ÐÑÐ»Ð¸ Ð¸Ð·ÑÑÐµÐ½Ñ Ð¿ÑÐµÐ´Ð¼ÐµÑÐ½Ð°Ñ Ð¾Ð±Ð»Ð°ÑÑÑ Ð³ÐµÐ¾Ð¿ÑÐ¾ÑÑÑÐ°Ð½ÑÑÐ²ÐµÐ½Ð½ÑÑ Ð´Ð°Ð½Ð½ÑÑ, Ð¿Ð¾Ð½ÑÑÐ¸Ñ Ð¸Ð½ÑÐµÐ³ÑÐ°ÑÐ¸Ð¸ Ð¸ ETL, Ð° ÑÐ°Ðº Ð¶Ðµ ÐºÐ¾Ð½ÑÐµÐ¿ÑÐ¸Ñ Ð¸Ð½ÑÑÑÑÐ¼ÐµÐ½ÑÐ° Ð¸Ð½ÑÐµÐ³ÑÐ°ÑÐ¸Ð¸ Apache NiFi. ÐÐ±Ð»Ð°ÑÑÑÑ Ð¿ÑÐ¸Ð¼ÐµÐ½ÐµÐ½Ð¸Ñ ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐ¾Ð² ÑÐ°Ð±Ð¾ÑÑ ÑÐ²Ð»ÑÐµÑÑÑ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð°ÑÐ¸Ñ Ð¿ÑÐ¾ÑÐµÑÑÐ° ÑÐ±Ð¾ÑÐ°, Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° Ð´Ð°Ð½Ð½ÑÑ. Ð ÐµÐ·ÑÐ»ÑÑÐ°ÑÐ¾Ð¼ ÑÐ°Ð±Ð¾ÑÑ ÑÐ²Ð»ÑÐµÑÑÑ ÐºÐ°ÑÐµÑÑÐ²ÐµÐ½Ð½Ð¾ ÑÐµÐ°Ð»Ð¸Ð·Ð¾Ð²Ð°Ð½Ð½Ð°Ñ ÑÐ¸ÑÑÐµÐ¼Ð°, ÐºÐ¾ÑÐ¾ÑÐ°Ñ Ð±ÑÐ»Ð° Ð¿ÑÐ¾ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð° Ð¸ Ð²Ð½ÐµÐ´ÑÐµÐ½Ð° Ð² ÐÐÐÐÐ. ÐÐ½ÐµÐ´ÑÐµÐ½Ð¸Ðµ Ð¿Ð¾ÐºÐ°Ð·Ð°Ð»Ð¾ Ð¿ÑÐ°ÐºÑÐ¸ÑÐµÑÐºÑÑ Ð·Ð½Ð°ÑÐ¸Ð¼Ð¾ÑÑÑ ÑÐ°Ð±Ð¾ÑÑ: ÑÐ¸ÑÑÐµÐ¼Ð° Ð¿ÑÐ¾Ð´ÐµÐ¼Ð¾Ð½ÑÑÑÐ¸ÑÐ¾Ð²Ð°Ð»Ð° Ð²ÑÑÐ¾ÐºÑÑ ÑÑÑÐµÐºÑÐ¸Ð²Ð½Ð¾ÑÑÑ Ð² ÑÑÐºÐ¾ÑÐµÐ½Ð¸Ð¸ Ð¿ÑÐ¾ÑÐµÑÑÐ° ÑÐ±Ð¾ÑÐ° Ð¸ Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ Ð´Ð°Ð½Ð½ÑÑ, ÑÑÑÐµÑÑÐ²ÐµÐ½Ð½Ð¾ ÑÐ¾ÐºÑÐ°ÑÐ¸Ð»Ð° Ð²ÑÐµÐ¼Ñ Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ Ð´Ð°Ð½Ð½ÑÑ Ð±Ð»Ð°Ð³Ð¾Ð´Ð°ÑÑ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð°ÑÐ¸Ð¸ ÑÑÑÐ¸Ð½Ð½ÑÑ Ð¾Ð¿ÐµÑÐ°ÑÐ¸Ð¹.
description: The object of the study is the field of data integration. The subject of the study is a distributed system for collecting, processing and analyzing geospatial data. The purpose of this work is to create a distributed system capable of efficiently collecting, processing and analyzing geospatial data using advanced data integration technologies. Tasks that were solved during the course of the work: â Set the requirements for the system being created and perform a review of the subject area. â Select the data integration tool to implement the system. â Implement a distributed system for collecting, processing and analyzing geospatial data using the selected tool. â Conduct testing and approbation of the implemented system. â Methods of comparative analysis of various data integration tools, as well as field research of the developed system were used. The subject area of geospatial data, the concepts of integration and ETL, as well as the concept of the Apache NiFi integration tool were studied. The scope of application of the results of the work is the automation of the process of data collection, processing and analysis. The result of the work is a qualitatively implemented system that has been tested and implemented in AARI. The implementation showed the practical significance of the work: the system demonstrated high efficiency in accelerating the process of data collection and processing, significantly reduced data processing time due to automation of routine operations.