title: Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð±Ð¸Ð±Ð»Ð¸Ð¾ÑÐµÐºÐ¸ Ð´Ð»Ñ ÑÐ´Ð°Ð»ÐµÐ½Ð½Ð¾Ð³Ð¾ ÑÐ°ÑÑÐµÑÐ° ÐºÑÑÐµÐ¹
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð±Ð°ÐºÐ°Ð»Ð°Ð²ÑÐ°
titleType: Subtitle
title: Development of a library for remote calculation of caches
Creators: name: ÐÐ°Ð»Ð¸Ð¼ÑÐ»Ð»Ð¸Ð½Ð°, ÐÐ¹Ð³ÑÐ»Ñ
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2024
Subjects: Java
Apache Zookeeper
Amazon S3
Ð¿ÑÐ¾ÑÐ¾ÐºÐ¾Ð» ÑÐµÑÐ¸Ð°Ð»Ð¸Ð·Ð°ÑÐ¸Ð¸ protobuf
serialization protocol protobuf

description: Ð¢ÐµÐ¼Ð° Ð²ÑÐ¿ÑÑÐºÐ½Ð¾Ð¹ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÑ: "Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð±Ð¸Ð±Ð»Ð¸Ð¾ÑÐµÐºÐ¸ Ð´Ð»Ñ ÑÐ´Ð°Ð»ÐµÐ½Ð½Ð¾Ð³Ð¾ ÑÐ°ÑÑÐµÑÐ° ÐºÑÑÐµÐ¹". Ð Ð°Ð±Ð¾ÑÐ° Ð¿Ð¾ÑÐ²ÑÑÐµÐ½Ð° ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐµ Ð±Ð¸Ð±Ð»Ð¸Ð¾ÑÐµÐºÐ¸ Ð´Ð»Ñ ÑÐ´Ð°Ð»ÐµÐ½Ð½Ð¾Ð³Ð¾ ÑÐ°ÑÑÐµÑÐ° ÐºÑÑÐµÐ¹, ÐºÐ¾ÑÐ¾ÑÐ°Ñ Ð±ÑÐ´ÐµÑ ÑÐ¾ÑÐµÑÐ°ÑÑ Ð² ÑÐµÐ±Ðµ Ð²ÑÑÐ¾ÐºÑÑ Ð¿ÑÐ¾Ð¸Ð·Ð²Ð¾Ð´Ð¸ÑÐµÐ»ÑÐ½Ð¾ÑÑÑ Ð¸ Ð½Ð°Ð´ÐµÐ¶Ð½Ð¾ÑÑÑ. ÐÐ»Ñ ÑÑÐ¾Ð³Ð¾ Ð¿ÑÐ¾Ð²Ð¾Ð´Ð¸ÑÑÑ ÑÐµÐ¾ÑÐµÑÐ¸ÑÐµÑÐºÐ¸Ð¹ Ð°Ð½Ð°Ð»Ð¸Ð· ÑÑÑÐµÑÑÐ²ÑÑÑÐ¸Ñ ÑÐµÑÐµÐ½Ð¸Ð¹, Ð²ÑÑÐ²Ð»ÑÑÑÑÑ Ð¸Ñ Ð¿Ð»ÑÑÑ Ð¸ Ð¼Ð¸Ð½ÑÑÑ. ÐÑÐ¾Ð¼Ðµ ÑÐ¾Ð³Ð¾, Ð¸ÑÑÐ»ÐµÐ´ÑÑÑÑÑ Ð¼ÐµÑÐ°Ð½Ð¸Ð·Ð¼Ñ ÐºÐ¾Ð½ÑÑÐ¾Ð»Ñ ÑÐµÐ»Ð¾ÑÑÐ½Ð¾-ÑÑÐ¸ Ð´Ð°Ð½Ð½ÑÑ Ð¸ Ð¼Ð¾Ð½Ð¸ÑÐ¾ÑÐ¸Ð½Ð³Ð° ÑÐ¾ÑÑÐ¾ÑÐ½Ð¸Ñ. Ð Ð¿ÑÐ¾ÑÐµÑÑÐµ ÑÐ°Ð±Ð¾ÑÑ Ð±ÑÐ»Ð¸ ÑÐ°ÑÑÐ¼Ð¾ÑÑÐµÐ½Ñ ÑÑÑÐµÑÑÐ²ÑÑÑÐ¸Ðµ Ð¼ÐµÑÐ¾Ð´Ñ ÑÐ°ÑÐ¿ÑÐ¾-ÑÑÑÐ°Ð½ÐµÐ½Ð¸Ñ Ð½Ð°Ð±Ð¾ÑÐ° Ð´Ð°Ð½Ð½ÑÑ. ÐÐ° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° ÑÑÐ¸Ñ Ð¼ÐµÑÐ¾Ð´Ð¾Ð² Ð±ÑÐ» ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½ ÑÐ¾Ð±ÑÑÐ²ÐµÐ½Ð½ÑÐ¹ ÑÐ¿Ð¾ÑÐ¾Ð±, ÐºÐ¾ÑÐ¾ÑÑÐ¹ Ð¸Ð¼ÐµÐµÑ Ð¿ÑÐµÐ¸Ð¼ÑÑÐµÑÑÐ²Ð¾ Ð² Ð±ÑÑÑÑÐ¾Ð´ÐµÐ¹ÑÑÐ²Ð¸Ð¸. Ð Ð¾ÑÐ½Ð¾-Ð²Ðµ ÑÑÐ¾Ð³Ð¾ Ð¼ÐµÑÐ¾Ð´Ð° Ð»ÐµÐ¶Ð¸Ñ Ð¸Ð´ÐµÑ ÑÑÐ°Ð½ÐµÐ½Ð¸Ñ Ð´Ð°Ð½Ð½ÑÑ Ð² Ð¾Ð±Ð»Ð°ÑÐ½Ð¾Ð¼ ÑÑÐ°Ð½Ð¸Ð»Ð¸ÑÐµ S3 Ð¸ Ð¸Ñ-Ð¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸Ðµ ÐºÐ¾Ð¾ÑÐ´Ð¸Ð½Ð°ÑÐ¾ÑÐ° ÑÐ¸ÑÑÐµÐ¼Ñ Zookeeper. ÐÐ»Ð°Ð³Ð¾Ð´Ð°ÑÑ ÑÐ°ÐºÐ¾Ð¼Ñ Ð¿Ð¾Ð´ÑÐ¾Ð´Ñ ÑÐ´Ð°-ÑÑÑÑ Ð´Ð¾ÑÑÐ¸Ð³Ð½ÑÑÑ ÑÑÐºÐ¾ÑÐµÐ½Ð¸Ñ Ð¿ÑÐ¾ÑÐµÑÑÐ¾Ð² Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ Ð´Ð°Ð½Ð½ÑÑ. Ð­ÑÐ¾ ÑÐ¿Ð¾ÑÐ¾Ð±ÑÑÐ²ÑÐµÑ Ð±Ð¾-Ð»ÐµÐµ ÑÑÑÐµÐºÑÐ¸Ð²Ð½Ð¾Ð¼Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸Ñ ÑÐµÑÑÑÑÐ¾Ð² Ð¸ ÑÐ¾ÐºÑÐ°ÑÐµÐ½Ð¸Ñ Ð²ÑÐµÐ¼ÐµÐ½Ð¸ ÑÐ°Ð±Ð¾ÑÑ Ñ Ð´Ð°Ð½Ð½ÑÐ¼Ð¸. ÐÑÐµÐ´Ð»Ð¾Ð¶ÐµÐ½Ð½Ð°Ñ Ð±Ð¸Ð±Ð»Ð¸Ð¾ÑÐµÐºÐ° Ð¿Ð¾Ð·Ð²Ð¾Ð»ÑÐµÑ ÑÐ¾Ð·Ð´Ð°Ð²Ð°ÑÑ Ð±Ð¾Ð»ÐµÐµ Ð³Ð¸Ð±ÐºÐ¸Ðµ ÑÐ¸ÑÑÐµÐ¼Ñ, ÐºÐ¾ÑÐ¾ÑÑÐµ Ð¿ÑÐ¾ÑÐµ Ð¼Ð°ÑÑÑÐ°Ð±Ð¸ÑÐ¾Ð²Ð°ÑÑ Ð¸ Ð»ÐµÐ³ÐºÐ¾ Ð°Ð´Ð°Ð¿ÑÐ¸ÑÐ¾Ð²Ð°ÑÑ Ð¿Ð¾Ð´ Ð½Ð¾Ð²ÑÐµ ÑÑÐµÐ±Ð¾Ð²Ð°Ð½Ð¸Ñ. Ð¢Ð°ÐºÐ¾Ðµ ÑÐµÑÐµÐ½Ð¸Ðµ Ð¿Ð¾Ð·Ð²Ð¾Ð»ÑÐµÑ Ð¿Ð¾Ð²ÑÑÐ¸ÑÑ Ð¿ÑÐ¾Ð¸Ð·Ð²Ð¾Ð´Ð¸ÑÐµÐ»ÑÐ½Ð¾ÑÑÑ Ð¸ ÐºÐ°ÑÐµÑÑÐ²Ð¾ ÑÐ°Ð·ÑÐ°Ð±Ð¾Ñ-ÐºÐ¸.
description: The topic of the final qualifying work is "Development of a library for remote calculation of caches." The work is devoted to the development of a library for remote cache calcula-tion, which will combine high performance and reliability. For this purpose, a theo-retical analysis of existing solutions is carried out, their pros and cons are identified. In addition, mechanisms for controlling data integrity and monitoring the status are being explored. During the work, existing methods for distributing a data set were reviewed. Based on the analysis of these methods, we developed our own method, which has the advantage of speed. This method is based on the idea of storing data in S3 cloud storage and using the Zookeeper system coordinator. Thanks to this approach, it is possible to achieve acceleration of data processing processes. This contributes to more efficient use of resources and reduces the time spent working with data. The proposed library allows you to create more flexible systems that are easier to scale and easily adapt to new requirements. This solution allows you to increase productivity and quality of development.