title: ÐÑÐµÐ´Ð¾ÑÐ²ÑÐ°ÑÐµÐ½Ð¸Ðµ ÑÑÐµÑÐµÐº ÐºÐ¾Ð½ÑÐ¸Ð´ÐµÐ½ÑÐ¸Ð°Ð»ÑÐ½ÑÑ Ð´Ð°Ð½Ð½ÑÑ Ñ Ð¿Ð¾Ð¼Ð¾ÑÑÑ Ð»ÐµÐ³ÐºÐ¾Ð²ÐµÑÐ½ÑÑ Ð±Ð¾Ð»ÑÑÐ¸Ñ ÑÐ·ÑÐºÐ¾Ð²ÑÑ Ð¼Ð¾Ð´ÐµÐ»ÐµÐ¹
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° ÑÐ¿ÐµÑÐ¸Ð°Ð»Ð¸ÑÑÐ°
titleType: Subtitle
title: Preventing confidential data leaks using lightweight large language models
Creators: name: Ð§ÐµÑÐµÐ½ÐµÐ², ÐÐ»ÐµÐºÑÐ°Ð½Ð´Ñ
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2025
Subjects: ÐºÐ¾Ð½ÑÐ¸Ð´ÐµÐ½Ð¸ÑÐ°Ð»ÑÐ½ÑÐµ Ð´Ð°Ð½Ð½ÑÐµ
ÑÐ¸ÑÑÐµÐ¼Ð° Ð¿ÑÐµÐ´Ð¾ÑÐ²ÑÐ°ÑÐµÐ½Ð¸Ñ ÑÑÐµÑÐµÐº
Ð±Ð¾Ð»ÑÑÐ°Ñ ÑÐ·ÑÐºÐ¾Ð²Ð°Ñ Ð¼Ð¾Ð´ÐµÐ»Ñ
qwen
fine-tunning
confidential data
data leak prevention system
large language model

description: Ð¦ÐµÐ»ÑÑ ÑÐ°Ð±Ð¾ÑÑ ÑÐ²Ð»ÑÐµÑÑÑ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð¼ÐµÑÐ¾Ð´Ð° Ð¿ÑÐµÐ´Ð¾ÑÐ²ÑÐ°ÑÐµÐ½Ð¸Ñ ÑÑÐµÑÐµÐº ÐºÐ¾Ð½ÑÐ¸Ð´ÐµÐ½ÑÐ¸Ð°Ð»ÑÐ½ÑÑ Ð´Ð°Ð½Ð½ÑÑ Ñ Ð¿Ð¾Ð¼Ð¾ÑÑÑ Ð»ÐµÐ³ÐºÐ¾Ð²ÐµÑÐ½Ð¾Ð¹ Ð±Ð¾Ð»ÑÑÐ¾Ð¹ ÑÐ·ÑÐºÐ¾Ð²Ð¾Ð¹ Ð¼Ð¾Ð´ÐµÐ»Ð¸. ÐÐ°Ð´Ð°ÑÐ¸, ÑÐµÑÐ°ÐµÐ¼ÑÐµ Ð² ÑÐ¾Ð´Ðµ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ: 1. ÐÑÑÐ»ÐµÐ´Ð¾Ð²Ð°ÑÑ Ð»ÐµÐ³ÐºÐ¾Ð²ÐµÑÐ½ÑÐµ LLM Ñ ÑÐµÐ»ÑÑ Ð²ÑÑÐ²Ð»ÐµÐ½Ð¸Ñ ÐºÐ¾Ð½ÑÐ¸Ð´ÐµÐ½ÑÐ¸Ð°Ð»ÑÐ½Ð¾Ð¹ Ð¸Ð½ÑÐ¾ÑÐ¼Ð°ÑÐ¸Ð¸ Ð¸ Ð¾Ð±Ð¾ÑÐ½Ð¾Ð²Ð°Ð½Ð½Ð¾Ð³Ð¾ Ð²ÑÐ±Ð¾ÑÐ° Ð½Ð°Ð¸Ð±Ð¾Ð»ÐµÐµ Ð¿Ð¾Ð´ÑÐ¾Ð´ÑÑÐµÐ¹ Ð¼Ð¾Ð´ÐµÐ»Ð¸ Ð´Ð»Ñ Ð¿Ð¾ÑÐ»ÐµÐ´ÑÑÑÐµÐ³Ð¾ ÑÐ»ÑÑÑÐµÐ½Ð¸Ñ. 2. ÐÐ¾Ð²ÑÑÐ¸ÑÑ ÑÐ¾ÑÐ½Ð¾ÑÑÑ ÑÐ°Ð±Ð¾ÑÑ Ð²ÑÐ±ÑÐ°Ð½Ð½Ð¾Ð¹ LLM. 3. Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐ°ÑÑ Ð¿ÑÐ¾ÑÐ¾ÑÐ¸Ð¿ ÑÐ¸ÑÑÐµÐ¼Ñ Ð¿ÑÐµÐ´Ð¾ÑÐ²ÑÐ°ÑÐµÐ½Ð¸Ñ ÑÑÐµÑÐµÐº Ð´Ð»Ñ ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Ð²ÑÐ±ÑÐ°Ð½Ð½Ð¾Ð¹ LLM. 4. ÐÑÐ¾Ð²ÐµÑÑÐ¸ Ð¾ÑÐµÐ½ÐºÑ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½Ð¾Ð³Ð¾ Ð¼ÐµÑÐ¾Ð´Ð°. Ð ÑÐ¾Ð´Ðµ Ð´Ð°Ð½Ð½Ð¾Ð¹ ÐÐÐ  Ð±ÑÐ» ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½ Ð¼ÐµÑÐ¾Ð´ Ð¿ÑÐµÐ´Ð¾ÑÐ²ÑÐ°ÑÐµÐ½Ð¸Ñ ÑÑÐµÑÐµÐº ÐºÐ¾Ð½ÑÐ¸Ð´ÐµÐ½ÑÐ¸Ð°Ð»ÑÐ½ÑÑ Ð´Ð°Ð½Ð½ÑÑ Ð¸Ð· ÐºÐ¾Ð½ÑÑÑÐ° Ð¾ÑÐ³Ð°Ð½Ð¸Ð·Ð°ÑÐ¸Ð¸ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð»ÐµÐ³ÐºÐ¾Ð²ÐµÑÐ½Ð¾Ð¹ Ð±Ð¾Ð»ÑÑÐ¾Ð¹ ÑÐ·ÑÐºÐ¾Ð²Ð¾Ð¹ Ð¼Ð¾Ð´ÐµÐ»Ð¸. ÐÑÑÐ¸ÑÐµÐºÑÑÑÐ°, Ð¼Ð¾Ð´ÐµÐ»Ñ Ð¸ Ð¿Ð°ÑÐ°Ð¼ÐµÑÑÑ ÑÐ¸ÑÑÐµÐ¼Ñ Ð²ÑÐ±Ð¸ÑÐ°Ð»Ð¸ÑÑ Ð¸ÑÑÐ¾Ð´Ñ Ð¸Ð· Ð°ÐºÑÑÐ°Ð»ÑÐ½ÑÑ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ð¹ 2023â2024 Ð³Ð¾Ð´Ð°. Ð¡Ð¸ÑÑÐµÐ¼Ð° Ð±ÑÐ»Ð° Ð¿ÑÐ¾ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð° Ð½Ð° Ð¿ÑÐ°ÐºÑÐ¸ÐºÐµ Ð¸ Ð¿Ð¾ÐºÐ°Ð·Ð°Ð»Ð° ÑÐµÐ·ÑÐ»ÑÑÐ°Ñ Ð»ÑÑÑÐµ Ð¸Ð»Ð¸ Ð½Ð° ÑÑÐ¾Ð²Ð½Ðµ ÑÐµÑÐµÐ½Ð¸Ñ, ÐºÐ¾ÑÐ¾ÑÐ¾Ðµ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·ÑÐµÑÑÑ ÑÐ¾ÑÑÐ¸Ð¹ÑÐºÐ¸Ð¼Ð¸ ÐºÐ¾Ð¼Ð¼ÐµÑÑÐµÑÐºÐ¸Ð¼Ð¸ ÐºÐ¾Ð¼Ð¿Ð°Ð½Ð¸ÑÐ¼Ð¸. Ð ÐµÐ·ÑÐ»ÑÑÐ°ÑÑ Ð´Ð°Ð½Ð½Ð¾Ð¹ ÐÐÐ  Ð±ÑÐ´ÑÑ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ñ Ð² ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐµ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð¾Ð³Ð¾ Ð¾Ð±ÐµÑÐ¿ÐµÑÐµÐ½Ð¸Ñ, ÐºÐ¾ÑÐ¾ÑÐ¾Ðµ Ð² Ð´Ð°Ð»ÑÐ½ÐµÐ¹ÑÐµÐ¼ Ð±ÑÐ´ÐµÑ Ð¿ÑÐµÐ´Ð»Ð°Ð³Ð°ÑÑÑÑ ÑÐ¾ÑÑÐ¸Ð¹ÑÐºÐ¸Ð¼ ÐºÐ¾Ð¼Ð¿Ð°Ð½Ð¸ÑÐ¼ Ð´Ð»Ñ ÑÐ¼ÐµÐ½ÑÑÐµÐ½Ð¸Ñ ÐºÐ¾Ð»Ð¸ÑÐµÑÑÐ²Ð° ÑÑÐµÑÐµÐº.
description: The purpose of this work is to develop a method for preventing confidential data leaks using a lightweight large language model. Research objectives: 1. Study lightweight LLMs to identify confidential information and justify the choice of the most suitable model for further improvement. 2. Improve the accuracy of the selected LLM. 3. Develop a prototype of a data leak prevention system to test the selected LLM. 4. Evaluate the developed method. As part of this final qualification work, a method was developed to prevent confidential data leaks from an organizationâs network based on a lightweight large language model. The systems architecture, model, and parameters were chosen based on the latest research from 2023â2024. The system was tested in practice and demonstrated performance that was either better than or on par with solutions currently used by Russian commercial companies. The results of this work will be utilized in the development of software that will be offered to Russian companies to reduce the number of data leaks.