title: ÐÐ¾Ð²ÑÑÐµÐ½Ð¸Ðµ Ð¿ÑÐ¾Ð¸Ð·Ð²Ð¾Ð´Ð¸ÑÐµÐ»ÑÐ½Ð¾ÑÑÐ¸ Ð²Ð·Ð°Ð¸Ð¼Ð¾Ð´ÐµÐ¹ÑÑÐ²Ð¸Ñ Ð¼Ð¸ÐºÑÐ¾ÑÐµÑÐ²Ð¸ÑÐ¾Ð² Ñ Ð¡Ð¥Ð Pravega Ð´Ð»Ñ Ð°Ð½Ð°Ð»Ð¸ÑÐ¸ÑÐµÑÐºÐ¾Ð¹ Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ Ð´Ð°Ð½Ð½ÑÑ
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¼Ð°Ð³Ð¸ÑÑÑÐ°
titleType: Subtitle
title: Improvement of microservices interaction performance with Pravega for analytical data processing
Creators: name: ÐÐ°ÐºÑÐ¸Ð¼ÑÑÐº, ÐÐ°Ð»ÐµÐ½ÑÐ¸Ð½
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2022
Subjects: ÐÐ°Ð·Ñ Ð´Ð°Ð½Ð½ÑÑ
ÐÑÑÐ¸ÑÐ»Ð¸ÑÐµÐ»ÑÐ½ÑÐµ Ð¼Ð°ÑÐ¸Ð½Ñ ÑÐ»ÐµÐºÑÑÐ¾Ð½Ð½ÑÐµ
ÑÐ¸ÑÑÐµÐ¼Ñ Ñ ÑÐ°Ð½ÐµÐ½Ð¸Ñ Ð´Ð°Ð½Ð½ÑÑ
Ð¼Ð¸ÐºÑÐ¾ÑÐµÑÐ²Ð¸ÑÐ½Ð°Ñ Ð°ÑÑ Ð¸ÑÐµÐºÑÑÑÐ°
ÑÐ°ÑÐ¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð½ÑÐµ ÑÐ¸ÑÑÐµÐ¼Ñ
data storages
microservice architecture
distributed systems

description: ÐÐ°Ð³Ð¸ÑÑÐµÑÑÐºÐ°Ñ Ð´Ð¸Ð¿Ð»Ð¾Ð¼Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¿Ð¾ÑÐ²ÑÑÐµÐ½Ð° Ð¿Ð¾Ð¸ÑÐºÑ Ð¿Ð¾Ð´ÑÐ¾Ð´Ð° Ð¿Ð¾Ð²ÑÑÐµÐ½Ð¸Ñ Ð¿ÑÐ¾Ð¸Ð·Ð²Ð¾Ð´Ð¸ÑÐµÐ»ÑÐ½Ð¾ÑÑÐ¸ ÑÐ¸ÑÑÐµÐ¼ Ð¿Ð¾ Ð°Ð½Ð°Ð»Ð¸ÑÐ¸ÑÐµÑÐºÐ¾Ð¹ Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ Ð´Ð°Ð½Ð½ÑÑ Ð¿ÑÑÐµÐ¼ ÑÐ»ÑÑÑÐµÐ½Ð¸Ñ Ð¼ÐµÑÐ°Ð½Ð¸Ð·Ð¼Ð¾Ð² Ð²Ð·Ð°Ð¸Ð¼Ð¾Ð´ÐµÐ¹ÑÑÐ²Ð¸Ñ Ñ Ð¡Ð¥Ð Pravega. ÐÑÐ¾Ð²ÐµÐ´ÐµÐ½ Ð¾Ð±Ð·Ð¾Ñ ÑÑÑÐµÑÑÐ²ÑÑÑÐ¸Ñ ÑÐ¿Ð¾ÑÐ¾Ð±Ð¾Ð² Ð¾ÑÐ³Ð°Ð½Ð¸Ð·Ð°ÑÐ¸Ð¸ Ð¼ÐµÐ¶ÑÐµÑÐ²Ð¸ÑÐ½Ð¾Ð³Ð¾ Ð²Ð·Ð°Ð¸Ð¼Ð¾Ð´ÐµÐ¹ÑÑÐ²Ð¸Ñ Ñ Ð´Ð°Ð½Ð½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ð¾Ð¹ ÑÑÐ°Ð½ÐµÐ½Ð¸Ñ Ð¸ Ð¿ÐµÑÐµÐ´Ð°ÑÐ¸ Ð´Ð°Ð½Ð½ÑÑ, Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ ÐºÐ¾ÑÐ¾ÑÐ¾Ð³Ð¾ Ð±ÑÐ»Ð¸ Ð²ÑÑÐ²Ð»ÐµÐ½Ñ ÑÑÑÐµÑÑÐ²ÑÑÑÐ¸Ðµ Ð½ÐµÐ´Ð¾ÑÑÐ°ÑÐºÐ¸ ÑÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ð¸ Ð² Ð¸ÑÐ¿Ð¾Ð»ÑÐ·ÑÐµÐ¼ÑÑ Ð¿Ð¾Ð´ÑÐ¾Ð´Ð°Ñ. Ð¢Ð°Ðº Ð¶Ðµ Ð±ÑÐ» Ð¿ÑÐ¾Ð²ÐµÐ´ÐµÐ½ Ð¾Ð±Ð·Ð¾Ñ ÑÐµÑÐ½Ð¾Ð»Ð¾Ð³Ð¸Ð¸ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ¸ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð¾Ð³Ð¾ Ð¾Ð±ÐµÑÐ¿ÐµÑÐµÐ½Ð¸Ñ Apache Arrow. Ð ÑÐ°Ð¼ÐºÐ°Ñ Ð´Ð°Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÑ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð¿Ð¾Ð»ÑÑÐµÐ½Ð½ÑÑ ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐ¾Ð² Ð±ÑÐ» Ð¿ÑÐµÐ´Ð»Ð¾Ð¶ÐµÐ½ Ð¿Ð¾Ð´ÑÐ¾Ð´ Ð¾ÑÐ³Ð°Ð½Ð¸Ð·Ð°ÑÐ¸Ð¸ Ð¿ÑÐ¾ÑÐµÑÑÐ¾Ð² Ð¿ÐµÑÐµÐ´Ð°ÑÐ¸ Ð´Ð°Ð½Ð½ÑÑ Ð¼ÐµÐ¶Ð´Ñ Ð¼Ð¸ÐºÑÐ¾ÑÐµÑÐ²Ð¸ÑÐ°Ð¼Ð¸ Ð¸ Ð¡Ð¥Ð Pravega, Ð° ÑÐ°ÐºÐ¶Ðµ Ð²Ð²ÐµÐ´ÐµÐ½ Ð½Ð¾Ð²ÑÐ¹ ÑÐ¾ÑÐ¼Ð°Ñ Ð´Ð°Ð½Ð½ÑÑ, Ñ ÑÐµÐ»ÑÑ Ð¿Ð¾Ð²ÑÑÐµÐ½Ð¸Ñ Ð¿ÑÐ¾Ð¸Ð·Ð²Ð¾Ð´Ð¸ÑÐµÐ»ÑÐ½Ð¾ÑÑÐ¸ Ð°Ð½Ð°Ð»Ð¸ÑÐ¸ÑÐµÑÐºÐ¾Ð¹ Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ Ð´Ð°Ð½Ð½ÑÑ. ÐÑÐµÐ´Ð»Ð¾Ð¶ÐµÐ½Ð½ÑÐ¹ Ð¼ÐµÑÐ°Ð½Ð¸Ð·Ð¼ Ð±ÑÐ» ÑÐµÐ°Ð»Ð¸Ð·Ð¾Ð²Ð°Ð½ Ð² Ð²Ð¸Ð´Ðµ ÐºÐ¾Ð½ÐµÑÐ½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ Ð¸ Ð¿ÑÐ¾ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½ Ð½Ð° ÑÐµÐ¾ÑÐµÑÐ¸ÑÐµÑÐºÐ¸ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½ÑÑ Ð´Ð°Ð½Ð½ÑÑ. ÐÐ°Ð»ÐµÐµ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð¿Ð¾Ð»ÑÑÐµÐ½Ð½ÑÑ ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐ¾Ð² Ð±ÑÐ»Ð° Ð¿ÑÐ¾Ð²ÐµÐ´ÐµÐ½Ð° Ð¾ÑÐµÐ½ÐºÐ° ÑÑÑÐµÐºÑÐ¸Ð²Ð½Ð¾ÑÑÐ¸ ÑÐ°Ð±Ð¾ÑÑ Ð´Ð°Ð½Ð½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ.Ð Ð¸ÑÐ¾Ð³Ðµ Ð´Ð°Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÑ Ð¿Ð¾Ð»ÑÑÐµÐ½Ð° ÐºÐ¾ÑÑÐµÐºÑÐ½Ð¾ ÑÐ°Ð±Ð¾ÑÐ°ÑÑÐ°Ñ ÑÐ¸ÑÑÐµÐ¼Ð°, Ð¾ÑÐ³Ð°Ð½Ð¸Ð·ÑÑÑÐ°Ñ Ð¼ÐµÐ¶ÑÐµÑÐ²Ð¸ÑÐ½Ð¾Ðµ Ð²Ð·Ð°Ð¸Ð¼Ð¾Ð´ÐµÐ¹ÑÑÐ²Ð¸Ðµ, Ð¾ÑÐ½Ð¾Ð²Ð°Ð½Ð½Ð¾Ð¹ Ð½Ð° Ð²ÑÐ·Ð¾Ð²Ðµ ÑÐ´Ð°Ð»ÐµÐ½Ð½ÑÑ Ð¿ÑÐ¾ÑÐµÐ´ÑÑ, Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸ÐµÐ¼ Ð¿Ð¾ÑÐ¾ÐºÐ° Ð´Ð°Ð½Ð½ÑÑ Ð² Pravega Ð¸ Ð²Ð½ÐµÐ´ÑÐµÐ½Ð½ÑÐ¼ ÑÐ¾ÑÐ¼Ð°ÑÐ¾Ð¼ Ð´Ð°Ð½Ð½ÑÑ,ÑÑÐ¾ Ð¿Ð¾Ð·Ð²Ð¾Ð»Ð¸Ð»Ð¾ Ð¿Ð¾Ð²ÑÑÐ¸ÑÑ Ð¿ÑÐ¾Ð¸Ð·Ð²Ð¾Ð´Ð¸ÑÐµÐ»ÑÐ½Ð¾ÑÑÑ Ð²Ð·Ð°Ð¸Ð¼Ð¾Ð´ÐµÐ¹ÑÑÐ²Ð¸Ñ Ð¼Ð¸ÐºÑÐ¾ÑÐµÑÐ²Ð¸ÑÐ¾Ð² Ñ Ð²ÑÑÐµÑÐ¿Ð¾Ð¼ÑÐ½ÑÑÐ¾Ð¹ Ð¡Ð¥Ð.
description: The master's thesis is devoted to finding an approach to improve the performanceof systems for analytical data processing by improving the mechanisms of interactionwith the Pravega storage system. A review of the existing ways of organizinginterservice communication with this data storage was conducted, based on which theexisting implementation problems in the using approaches were identified. A reviewof Apache Arrow software development technology was also conducted.As part of this work, based on obtained results, an approach for organizing datatransfer processes between Pravega and microservices was proposed. The new dataformat was introduced to increase the performance of analytical data processing. Theproposed mechanism was implemented as a final system and evaluated on theoreticallydeveloped data. Further, based on the obtained results, an assessment of the efficiencyof this system was evaluated. As a result of this work, a correctly working system that organizes interserviceinteraction based on remote procedure calls was obtained, using a data flow in Pravegaand an embedded data format, which made it possible to increase the performance ofmicroservices interaction with the storage system.