title: ÐÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ðµ Ð°ÑÑ Ð¸ÑÐµÐºÑÑÑÑ ÑÐ°ÑÐ¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð½Ð¾Ð³Ð¾ ÑÐµÐ»ÑÑÐ¸Ð¾Ð½Ð½Ð¾Ð³Ð¾ Ñ ÑÐ°Ð½Ð¸Ð»Ð¸ÑÐ° Ð±Ð¾Ð»ÑÑÐ¾Ð³Ð¾ Ð¾Ð±ÑÑÐ¼Ð° ÑÐ°Ð·Ð½Ð¾ÑÐ¾Ð´Ð½ÑÑ Ð´Ð°Ð½Ð½ÑÑ
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¼Ð°Ð³Ð¸ÑÑÑÐ°
titleType: Subtitle
title: The architecture of distributed relational storage of large volume of heterogeneous data study
Creators: name: ÐÐ¸ÑÐµÐ½ÐºÐ¾Ð²Ð°, ÐÐ½Ð½Ð°
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2020
Subjects: ÐºÐ»Ð°ÑÑÐµÑ
ÑÐ°ÑÐ´Ð¸Ð½Ð³
Ð³Ð¾ÑÐ¸Ð·Ð¾Ð½ÑÐ°Ð»ÑÐ½Ð¾Ðµ Ð¼Ð°ÑÑÑÐ°Ð±Ð¸ÑÐ¾Ð²Ð°Ð½Ð¸Ðµ
ÑÐµÐ»ÑÑÐ¸Ð¾Ð½Ð½ÑÐµ Ð±Ð°Ð·Ñ Ð´Ð°Ð½Ð½ÑÑ
big data
PostgreSQL
cluster
sharding
horizontal scaling
RDBMS

description: Ð¢ÐµÐ¼Ð° Ð²ÑÐ¿ÑÑÐºÐ½Ð¾Ð¹ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÑ: Â«ÐÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ðµ Ð°ÑÑÐ¸ÑÐµÐºÑÑÑÑ ÑÐ°ÑÐ¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð½Ð¾Ð³Ð¾ ÑÐµÐ»ÑÑÐ¸Ð¾Ð½Ð½Ð¾Ð³Ð¾ ÑÑÐ°Ð½Ð¸Ð»Ð¸ÑÐ° Ð±Ð¾Ð»ÑÑÐ¾Ð³Ð¾ Ð¾Ð±ÑÑÐ¼Ð° ÑÐ°Ð·Ð½Ð¾ÑÐ¾Ð´Ð½ÑÑ Ð´Ð°Ð½Ð½ÑÑÂ». ÐÑÐ¸ ÑÐ°Ð±Ð¾ÑÐµ Ñ Ð±Ð°Ð·Ð°Ð¼Ð¸ Ð´Ð°Ð½Ð½ÑÑ Ð±Ð¾Ð»ÑÑÐ¸Ñ Ð¾Ð±ÑÑÐ¼Ð¾Ð² Ð²Ð¾Ð·Ð½Ð¸ÐºÐ°ÐµÑ Ð¿ÑÐ¾Ð±Ð»ÐµÐ¼Ð° Ð´Ð»Ð¸ÑÐµÐ»ÑÐ½Ð¾Ð³Ð¾ Ð²ÑÐµÐ¼ÐµÐ½Ð¸ Ð´Ð¾ÑÑÑÐ¿Ð° Ðº Ð´Ð°Ð½Ð½ÑÐ¼. ÐÐµÑÐ¾Ð´Ñ Ð²ÐµÑÑÐ¸ÐºÐ°Ð»ÑÐ½Ð¾Ð³Ð¾ Ð¸ Ð³Ð¾ÑÐ¸Ð·Ð¾Ð½ÑÐ°Ð»ÑÐ½Ð¾Ð³Ð¾ Ð¼Ð°ÑÑÑÐ°Ð±Ð¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Ð¿Ð¾Ð·Ð²Ð¾Ð»ÑÑÑ ÑÐ²ÐµÐ»Ð¸ÑÐ¸ÑÑ Ð¿ÑÐ¾Ð¸Ð·Ð²Ð¾Ð´Ð¸ÑÐµÐ»ÑÐ½Ð¾ÑÑÑ ÑÐ¸ÑÑÐµÐ¼Ñ Ð·Ð° ÑÑÐµÑ Ð¾ÑÐ³Ð°Ð½Ð¸Ð·Ð°ÑÐ¸Ð¸ ÐºÐ»Ð°ÑÑÐµÑÐ° Ð¸ ÑÐ°ÑÐ¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð¸Ñ Ð´Ð°Ð½Ð½ÑÑ Ð¼ÐµÐ¶Ð´Ñ Ð½ÐµÑÐºÐ¾Ð»ÑÐºÐ¸Ð¼Ð¸ ÑÐµÑÐ²ÐµÑÐ°Ð¼Ð¸. Ð Ð°Ð±Ð¾ÑÐ° Ð¿Ð¾ÑÐ²ÑÑÐµÐ½Ð° ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐµ Ð¸ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ Ð°ÑÑÐ¸ÑÐµÐºÑÑÑÑ ÑÐ°ÑÐ¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð½Ð¾Ð³Ð¾ ÑÐµÐ»ÑÑÐ¸Ð¾Ð½Ð½Ð¾Ð³Ð¾ ÑÑÐ°Ð½Ð¸Ð»Ð¸ÑÐ° Ð±Ð¾Ð»ÑÑÐ¾Ð³Ð¾ Ð¾Ð±ÑÑÐ¼Ð° ÑÐ°Ð·Ð½Ð¾ÑÐ¾Ð´Ð½ÑÑ Ð´Ð°Ð½Ð½ÑÑ. ÐÐ°Ð´Ð°ÑÐ¸, ÐºÐ¾ÑÐ¾ÑÑÐµ ÑÐµÑÐ°Ð»Ð¸ÑÑ Ð² ÑÐ¾Ð´Ðµ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ: 1. ÐÐ·ÑÑÐµÐ½Ð¸Ðµ Ð¾ÑÐ¾Ð±ÐµÐ½Ð½Ð¾ÑÑÐµÐ¹ Ð¿Ð¾ÑÑÑÐ¾ÐµÐ½Ð¸Ñ ÑÐ°ÑÐ¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð½ÑÑ ÑÑÐ°Ð½Ð¸Ð»Ð¸Ñ Ð´Ð°Ð½Ð½ÑÑ. 2. ÐÑÑÐ²Ð»ÐµÐ½Ð¸Ðµ Ð¾ÑÐ½Ð¾Ð²Ð½ÑÑ ÐºÐ¾Ð¼Ð¿Ð¾Ð½ÐµÐ½Ñ, Ð½ÐµÐ¾Ð±ÑÐ¾Ð´Ð¸Ð¼ÑÑ Ð´Ð»Ñ Ð¾ÑÐ³Ð°Ð½Ð¸Ð·Ð°ÑÐ¸Ð¸ ÐºÐ»Ð°ÑÑÐµÑÐ°. 3. ÐÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ðµ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð´ÐµÐºÐ¾Ð¼Ð¿Ð¾Ð·Ð°ÑÐ¸Ð¸ Ð´Ð°Ð½Ð½ÑÑ. 4. Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð°ÑÑÐ¸ÑÐµÐºÑÑÑÑ ÑÐ°ÑÐ¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð½Ð¾Ð³Ð¾ ÑÐµÐ»ÑÑÐ¸Ð¾Ð½Ð½Ð¾Ð³Ð¾ ÑÑÐ°Ð½Ð¸Ð»Ð¸ÑÐ°. 5. ÐÐ½Ð°Ð»Ð¸Ð· Ð¿ÑÐ¾Ð¸Ð·Ð²Ð¾Ð´Ð¸ÑÐµÐ»ÑÐ½Ð¾ÑÑÐ¸ Ð¿Ð¾ÑÑÑÐ¾ÐµÐ½Ð½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ. Ð ÑÐ°Ð±Ð¾ÑÐµ Ð¿ÑÐ¾Ð°Ð½Ð°Ð»Ð¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ñ Ð¿Ð¾Ð´ÑÐ¾Ð´Ñ Ðº Ð¾ÑÐ³Ð°Ð½Ð¸Ð·Ð°ÑÐ¸Ð¸ ÑÐ°ÑÐ¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð½ÑÑ ÑÐµÐ»ÑÑÐ¸Ð¾Ð½Ð½ÑÑ Ð¸ NoSQL ÑÑÐ°Ð½Ð¸Ð»Ð¸Ñ. Ð ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐµ ÑÐ¿ÑÐ¾ÐµÐºÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð° Ð°ÑÑÐ¸ÑÐµÐºÑÑÑÐ° ÑÐ°ÑÐ¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð½Ð¾Ð³Ð¾ ÑÑÐ°Ð½Ð¸Ð»Ð¸ÑÐ° Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð¡Ð£ÐÐ PostgreSQL Ð¸ ÑÐ°ÑÑÐ¸ÑÐµÐ½Ð¸Ñ Citus, ÑÐµÐ°Ð»Ð¸Ð·Ð¾Ð²Ð°Ð½ Ð¼Ð°ÐºÐµÑ ÐºÐ»Ð°ÑÑÐµÑÐ°, ÑÐ¾ÑÑÐ¾ÑÑÐ¸Ð¹ Ð¸Ð· Ð´Ð²ÑÑ ÑÐµÑÐ²ÐµÑÐ¾Ð², Ð° ÑÐ°ÐºÐ¶Ðµ Ð¿ÑÐ¾Ð²ÐµÐ´ÐµÐ½ ÑÑÐ°Ð²Ð½Ð¸ÑÐµÐ»ÑÐ½ÑÐ¹ Ð°Ð½Ð°Ð»Ð¸Ð· Ð¿ÑÐ¾Ð¸Ð·Ð²Ð¾Ð´Ð¸ÑÐµÐ»ÑÐ½Ð¾ÑÑÐ¸ Ð¿Ð¾Ð»ÑÑÐµÐ½Ð½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ Ñ Ð¾Ð´Ð½Ð¾ÑÐ·Ð»Ð¾Ð²ÑÐ¼ ÑÐµÑÐµÐ½Ð¸ÐµÐ¼. Ð ÐµÐ·ÑÐ»ÑÑÐ°ÑÑ Ð¼Ð¾Ð³ÑÑ Ð±ÑÑÑ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ñ Ð´Ð»Ñ Ð¿Ð¾ÑÑÑÐ¾ÐµÐ½Ð¸Ñ ÑÐ°ÑÐ¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð½ÑÑ ÑÑÐ°Ð½Ð¸Ð»Ð¸Ñ Ð±Ð¾Ð»ÑÑÐ¾Ð³Ð¾ Ð¾Ð±ÑÑÐ¼Ð° ÑÐ°Ð·Ð½Ð¾ÑÐ¾Ð´Ð½ÑÑ Ð´Ð°Ð½Ð½ÑÑ Ñ Ð²ÑÑÐ¾ÐºÐ¾Ð¹ ÑÑÐµÐ¿ÐµÐ½ÑÑ ÑÑÑÐ¾Ð¹ÑÐ¸Ð²Ð¾ÑÑÐ¸ Ð¸ Ð±ÑÑÑÑÑÐ¼ Ð´Ð¾ÑÑÑÐ¿Ð¾Ð¼ Ðº Ð´Ð°Ð½Ð½ÑÐ¼.
description: The subject of the graduate qualification work is âThe architecture of distributed relational storage of large volume of heterogeneous data studyâ. When working with databases of large volumes, the problem of a long access time to the data arises. The methods of vertical and horizontal scaling can increase system performance by organizing a cluster and distributing data between multiple servers. The given work is devoted to the architecture of the distributed relational storage of large volume of heterogeneous data development and study. The research set the following goals: 1. The study of building distributed data warehouses features. 2. Identification of the main components necessary for the organization of the cluster. 3. The study of data decomposition algorithms. 4. Development of distributed relational storage architecture. 5. Analysis of the built system performance. The study resulted into analysis of the approaches to the organization of distributed relational and NoSQL repositories. As a result, the architecture of distributed storage based on the PostgreSQL DBMS and the Citus extension was designed, a cluster layout consisting of two servers was implemented, and a comparative analysis of the performance of the resulting system with a single-node solution was carried out. The results can be used to build distributed storages of a large volume of heterogeneous data with a high degree of stability and quick access to data.