title: Full-cycle integration and delivery system developent for an intelligent system
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¼Ð°Ð³Ð¸ÑÑÑÐ°
titleType: Subtitle
title: ÐÐ¾Ð»Ð½ÑÐ¹ ÑÐ¸ÐºÐ» Ð¸Ð½ÑÐµÐ³ÑÐ°ÑÐ¸Ð¸ Ð¸ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ¸ ÑÐ¸ÑÑÐµÐ¼Ñ Ð´Ð¾ÑÑÐ°Ð²ÐºÐ¸ Ð¸Ð½ÑÐµÐ»Ð»ÐµÐºÑÑÐ°Ð»ÑÐ½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ
Creators: name: ÐÑÐ°Ð¼Ð°ÑÐ¾Ð², ÐÐ²Ð³ÐµÐ½Ð¸Ð¹
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2023
Subjects: ÐÐ°ÑÐ¸Ð½Ð½Ð¾Ðµ Ð¾Ð±ÑÑÐµÐ½Ð¸Ðµ
ÐÑÑÐ¸ÑÐ»Ð¸ÑÐµÐ»ÑÐ½ÑÐµ Ð¼Ð°ÑÐ¸Ð½Ñ ÑÐ»ÐµÐºÑÑÐ¾Ð½Ð½ÑÐµ
Ð½ÐµÐ¿ÑÐµÑÑÐ²Ð½Ð°Ñ Ð¸Ð½ÑÐµÐ³ÑÐ°ÑÐ¸Ñ
Ð½ÐµÐ¿ÑÐµÑÑÐ²Ð½Ð°Ñ Ð¿Ð¾ÑÑÐ°Ð²ÐºÐ°
Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð°ÑÐ¸Ñ
ÑÐ¿Ð°ÐºÐ¾Ð²ÐºÐ° Ð¼Ð¾Ð´ÐµÐ»ÐµÐ¹
continuous integration
continuous delivery
automatization
model packaging

description: ÐÑÐ½Ð¾Ð²Ð½Ð¾Ð¹ ÑÐµÐ»ÑÑ Ð´Ð°Ð½Ð½Ð¾Ð¹ ÑÑÐ°ÑÑÐ¸ Ð¿Ð¾Ð´ Ð½Ð°Ð·Ð²Ð°Ð½Ð¸ÐµÐ¼ Â«Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° ÑÐ¸ÑÑÐµÐ¼Ñ Ð¿Ð¾Ð»Ð½Ð¾Ð³Ð¾ ÑÐ¸ÐºÐ»Ð° Ð¸Ð½ÑÐµÐ³ÑÐ°ÑÐ¸Ð¸ Ð¸ Ð´Ð¾ÑÑÐ°Ð²ÐºÐ¸ Ð¸Ð½ÑÐµÐ»Ð»ÐµÐºÑÑÐ°Ð»ÑÐ½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼ÑÂ» Ð±ÑÐ»Ð° ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° ÑÐ¸ÑÑÐµÐ¼Ñ Ð¿Ð¾Ð»Ð½Ð¾Ð³Ð¾ ÑÐ¸ÐºÐ»Ð° Ð½ÐµÐ¿ÑÐµÑÑÐ²Ð½Ð¾Ð¹ Ð¸Ð½ÑÐµÐ³ÑÐ°ÑÐ¸Ð¸ Ð¸ Ð½ÐµÐ¿ÑÐµÑÑÐ²Ð½Ð¾Ð¹ Ð´Ð¾ÑÑÐ°Ð²ÐºÐ¸ Ð¼Ð¾Ð´ÐµÐ»ÐµÐ¹ Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ð´Ð»Ñ Ð¿ÐµÑÐ¸ÑÐµÑÐ¸Ð¹Ð½ÑÑ ÑÑÑÑÐ¾Ð¹ÑÑÐ². Ð­ÑÐ¾Ð³Ð¾ Ð¼Ð¾Ð¶Ð½Ð¾ Ð´Ð¾Ð±Ð¸ÑÑÑÑ Ð·Ð° ÑÑÐµÑ ÑÐ¾Ð·Ð´Ð°Ð½Ð¸Ñ ÐºÐ¾Ð½Ð²ÐµÐ¹ÐµÑÐ° Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ Ð´Ð°Ð½Ð½ÑÑ Ð¸ ÐºÐ¾Ð´Ð°, Ð¿Ð¾ÑÑÑÐ¾ÐµÐ½Ð½Ð¾Ð³Ð¾ Ñ ÑÑÐµÑÐ¾Ð¼ Ð¾ÑÐ½Ð¾Ð²Ð½ÑÑ Ð¿ÑÐ¸Ð½ÑÐ¸Ð¿Ð¾Ð² Ð¼ÐµÑÐ¾Ð´Ð¾Ð»Ð¾Ð³Ð¸Ð¹ DevOps Ð¸ MLOps. ÐÐ»Ñ Ð¿Ð¾ÑÑÑÐ¾ÐµÐ½Ð¸Ñ ÑÐ°ÐºÐ¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ Ð½ÐµÐ¾Ð±ÑÐ¾Ð´Ð¸Ð¼Ñ ÑÐ»ÐµÐ´ÑÑÑÐ¸Ðµ ÐºÐ¾Ð¼Ð¿Ð¾Ð½ÐµÐ½ÑÑ: - Ð¥ÑÐ°Ð½ÐµÐ½Ð¸Ðµ ÐºÐ¾Ð´Ð°; - Ð¥ÑÐ°Ð½Ð¸Ð»Ð¸ÑÐµ Ð´Ð°Ð½Ð½ÑÑ; - Ð¡Ð¸ÑÑÐµÐ¼Ð° Ð·Ð°Ð¿ÑÑÐºÐ° Ð¸ Ð²ÑÐµÐ¼ÐµÐ½Ð¸ Ð²ÑÐ¿Ð¾Ð»Ð½ÐµÐ½Ð¸Ñ ÑÑÐ°Ð¿Ð¾Ð² ÐºÐ¾Ð½Ð²ÐµÐ¹ÐµÑÐ°; - Ð¡Ð¸ÑÑÐµÐ¼Ð° ÑÑÐ°Ð½ÐµÐ½Ð¸Ñ Ð¸ Ð²Ð¾ÑÐ¿ÑÐ¾Ð¸Ð·Ð²ÐµÐ´ÐµÐ½Ð¸Ñ ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐ¾Ð² ÑÐºÑÐ¿ÐµÑÐ¸Ð¼ÐµÐ½ÑÐ¾Ð²; - Ð¡Ð¸ÑÑÐµÐ¼Ð° Ð¾Ð±Ð½Ð¾Ð²Ð»ÐµÐ½Ð¸Ñ ÐºÐ¾Ð½ÑÐ¸Ð³ÑÑÐ°ÑÐ¸Ð¸ ÑÐµÐ»ÐµÐ²Ð¾Ð³Ð¾ Ð¿ÐµÑÐ¸ÑÐµÑÐ¸Ð¹Ð½Ð¾Ð³Ð¾ ÑÑÑÑÐ¾Ð¹ÑÑÐ²Ð°. Ð ÑÐ¾Ð´Ðµ Ð´Ð°Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÑ Ð²ÑÐµ Ð²ÑÑÐµÐ¿ÐµÑÐµÑÐ¸ÑÐ»ÐµÐ½Ð½ÑÐµ ÑÐ¸ÑÑÐµÐ¼Ñ ÑÐ¾Ð·Ð´Ð°Ð½Ð¸Ñ Ð°Ð²ÑÐ¾Ð½Ð¾Ð¼Ð½ÑÑ ÑÑÑÐ±Ð¾Ð¿ÑÐ¾Ð²Ð¾Ð´Ð¾Ð² Ð±ÑÐ»Ð¸ Ð½Ð°ÑÑÑÐ¾ÐµÐ½Ñ Ð¸ Ð½Ð°ÑÑÑÐ¾ÐµÐ½Ñ Ð´Ð»Ñ ÑÐ°Ð±Ð¾ÑÑ Ð² ÐµÐ´Ð¸Ð½Ð¾Ð¹ ÑÑÐµÐ´Ðµ ÑÐ°Ð·ÑÐ°Ð±Ð°ÑÑÐ²Ð°ÐµÐ¼Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ. ÐÐ¾Ð»ÑÑÐµÐ½Ð½ÑÐ¹ ÐºÐ¾Ð½Ð²ÐµÐ¹ÐµÑ Ð¿Ð¾Ð·Ð²Ð¾Ð»ÑÐµÑ Ð¿Ð¾Ð»Ð½Ð¾ÑÑÑÑ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð¸ÑÐ¾Ð²Ð°ÑÑ Ð¸Ð½ÑÐµÐ³ÑÐ°ÑÐ¸Ñ Ð¸ Ð´Ð¾ÑÑÐ°Ð²ÐºÑ Ð¼Ð¾Ð´ÐµÐ»Ð¸ Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ð´Ð»Ñ Ð¿ÐµÑÐ¸ÑÐµÑÐ¸Ð¹Ð½Ð¾Ð³Ð¾ ÑÑÑÑÐ¾Ð¹ÑÑÐ²Ð°. ÐÐ¾Ð»ÑÑÐµÐ½Ð½Ð°Ñ ÑÐ¸ÑÑÐµÐ¼Ð° Ð±ÑÐ´ÐµÑ ÑÐµÐ½Ð½Ð° Ð´Ð»Ñ Ð½ÐµÐ±Ð¾Ð»ÑÑÐ¸Ñ ÐºÐ¾Ð¼Ð¿Ð°Ð½Ð¸Ð¹, ÐºÐ¾ÑÐ¾ÑÑÐµ ÑÐ¾Ð·Ð´Ð°ÑÑ Ð¿ÑÐ¾Ð´ÑÐºÑÑ Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸ÐµÐ¼ Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð¿Ð»Ð°ÑÑÐ¾ÑÐ¼ Ð¿ÐµÑÐ¸ÑÐµÑÐ¸Ð¹Ð½ÑÑ ÑÑÑÑÐ¾Ð¹ÑÑÐ² Ð¸ Ð¸Ð·Ð¾ Ð²ÑÐµÑ ÑÐ¸Ð» Ð¿ÑÑÐ°ÑÑÑÑ Ð¿Ð¾Ð·Ð²Ð¾Ð»Ð¸ÑÑ ÑÐµÐ±Ðµ Ð¾Ð±Ð»Ð°ÑÐ½ÑÐµ ÑÐµÑÑÑÑÑ Ð´Ð»Ñ ÑÐ²Ð¾Ð¸Ñ ÑÐµÐ»ÐµÐ¹. ÐÑÑÐ¿Ð½ÑÐµ ÐºÐ¾Ð¼Ð¿Ð°Ð½Ð¸Ð¸, ÐºÐ¾ÑÐ¾ÑÑÐµ ÑÐ°Ð±Ð¾ÑÐ°ÑÑ Ñ ÑÐ°ÑÑÐ½ÑÐ¼Ð¸ Ð¸Ð»Ð¸ ÐºÐ¾Ð½ÑÐ¸Ð´ÐµÐ½ÑÐ¸Ð°Ð»ÑÐ½ÑÐ¼Ð¸ Ð´Ð°Ð½Ð½ÑÐ¼Ð¸, ÑÐ°ÑÐºÑÑÑÐ¸Ðµ ÐºÐ¾ÑÐ¾ÑÑÑ Ð¼Ð¾Ð¶ÐµÑ Ð²ÑÐ·Ð²Ð°ÑÑ ÑÐµÐ¿ÑÑÐ°ÑÐ¸Ð¾Ð½Ð½ÑÐµ Ð¸Ð»Ð¸ ÑÑÐ¸Ð´Ð¸ÑÐµÑÐºÐ¸Ðµ Ð¿ÑÐ¾Ð±Ð»ÐµÐ¼Ñ, ÑÐ°ÐºÐ¶Ðµ Ð¼Ð¾Ð³ÑÑ Ð¿Ð¾Ð»ÑÑÐ¸ÑÑ Ð²ÑÐ³Ð¾Ð´Ñ Ð¾Ñ ÑÐ°ÑÑÐ¸ÑÐ½Ð¾Ð³Ð¾ Ð¸Ð»Ð¸ Ð¿Ð¾Ð»Ð½Ð¾Ð³Ð¾ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸Ñ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ. ÐÐ¾Ð»ÑÑÐµÐ½Ð½Ð°Ñ ÑÐ¸ÑÑÐµÐ¼Ð° Ð±ÑÐ»Ð° Ð¿ÑÐ¾ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð° Ð½Ð° ÐºÐ¾Ð½ÐºÑÐµÑÐ½Ð¾Ð¼ Ð¸ÑÐ¿ÑÑÐ°ÑÐµÐ»ÑÐ½Ð¾Ð¼ ÑÑÐµÐ½Ð´Ðµ Ð¸ ÑÐ¾ÑÐ¾ÑÐ¾ Ð·Ð°ÑÐµÐºÐ¾Ð¼ÐµÐ½Ð´Ð¾Ð²Ð°Ð»Ð° ÑÐµÐ±Ñ Ð² ÑÐµÐ°Ð»ÑÐ½Ð¾Ð¼ ÑÑÐµÐ½Ð°ÑÐ¸Ð¸ Ð¾Ð±Ð½Ð¾Ð²Ð»ÐµÐ½Ð¸Ñ Ð¼Ð¾Ð´ÐµÐ»Ð¸.
description: The main purpose of this paper, called âFull-cycle integration and delivery system development for an intelligent systemâ was the development of a full cycle system for continuous integration and continuous delivery for machine learning models for edge devices. This can be achieved through creation of a pipeline of data and code processing, built with consideration of main principles of DevOps and MLOps methodologies. To build such a system the following components are required: - Code storage; - Data storage; - System for triggering and runtime for pipeline steps; - Storage and reproduction system for experiments results; - System for updating the configuration of the target edge device. During this work, all the forementioned systems for autonomous pipeline creation have been set up and configured to work in the single environment of the developed system. Resulting pipeline allows to completely automate integration and delivery of a machine learning model for an edge device. The resulting system is valuable for smaller companies that create products using machine learning, based on edge devices platforms, and are struggling to afford cloud resources for their purposes. Big companies that are working with private or sensitive data, that may cause reputational or legal problems once exposed, may also benefit from using the developed system partially or completely. The resulting system has been tested on a specific testbench and performed well in a real-life scenario of a model update.