title: Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° ÑÑÐµÐ´ÑÑÐ²Ð° Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð°ÑÐ¸Ð¸ ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Ð² Ð¿ÑÐ¾ÑÐµÑÑÐµ Ð½ÐµÐ¿ÑÐµÑÑÐ²Ð½Ð¾Ð¹ Ð¸Ð½ÑÐµÐ³ÑÐ°ÑÐ¸Ð¸ Ñ Ð¿Ð¾Ð¼Ð¾ÑÑÑ Ð±Ð¾Ð»ÑÑÐ¸Ñ ÑÐ·ÑÐºÐ¾Ð²ÑÑ Ð¼Ð¾Ð´ÐµÐ»ÐµÐ¹
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð±Ð°ÐºÐ°Ð»Ð°Ð²ÑÐ°
titleType: Subtitle
title: Development of a test automation tool for continuous integration testing using large language models
Creators: name: ÐÑÐ¿ÑÐ½Ð¾Ð²Ð°, Ð®Ð»Ð¸Ñ
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2025
Subjects: Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ð½Ð¾Ðµ ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ðµ
automated testing

description: ÐÑÐµÐ´Ð¼ÐµÑÐ¾Ð¼ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ ÑÐ²Ð»ÑÐµÑÑÑ ÑÐµÑÐ½Ð¾Ð»Ð¾Ð³Ð¸Ð¸ Ð¿ÑÐ¸Ð¼ÐµÐ½ÐµÐ½Ð¸Ñ LLM Ð´Ð»Ñ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð°ÑÐ¸Ð¸ ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð¾Ð³Ð¾ Ð¾Ð±ÐµÑÐ¿ÐµÑÐµÐ½Ð¸Ñ Ð² Ð¿ÑÐ¾ÑÐµÑÑÐµ Ð½ÐµÐ¿ÑÐµÑÑÐ²Ð½Ð¾Ð¹ Ð¸Ð½ÑÐµÐ³ÑÐ°ÑÐ¸Ð¸. Ð¦ÐµÐ»Ñ Ð´Ð°Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÑ Ð·Ð°ÐºÐ»ÑÑÐ°ÐµÑÑÑ Ð² ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐµ ÑÐ¸ÑÑÐµÐ¼Ñ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð°ÑÐ¸Ð¸ ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð¾Ð³Ð¾ Ð¾Ð±ÐµÑÐ¿ÐµÑÐµÐ½Ð¸Ñ, Ð¸ÑÐ¿Ð¾Ð»ÑÐ·ÑÑÑÐµÐ¹ Ð¿Ð¾Ð´ÑÐ¾Ð´ÑÑÐ¸Ðµ LLM, Ð² Ð¿ÑÐ¾ÑÐµÑÑÐµ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ¸ ÑÑÐ¾Ð³Ð¾ Ð¾Ð±ÐµÑÐ¿ÐµÑÐµÐ½Ð¸Ñ Ð¸ Ð½ÐµÐ¿ÑÐµÑÑÐ²Ð½Ð¾Ð¹ Ð¸Ð½ÑÐµÐ³ÑÐ°ÑÐ¸Ð¸ Ð¾Ð±Ð½Ð¾Ð²Ð»ÐµÐ½Ð¸Ð¹ Ð² Ð½ÐµÐ³Ð¾. Ð ÑÐ°Ð¼ÐºÐ°Ñ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ Ð±ÑÐ» Ð¿ÑÐ¾Ð²ÐµÐ´ÐµÐ½ ÑÑÐ°Ð²Ð½Ð¸ÑÐµÐ»ÑÐ½ÑÐ¹ Ð°Ð½Ð°Ð»Ð¸Ð· ÑÑÑÐµÑÑÐ²ÑÑÑÐ¸Ñ Ð¸Ð½ÑÑÑÑÐ¼ÐµÐ½ÑÐ¾Ð² Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð°ÑÐ¸Ð¸ ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ. ÐÐ·ÑÑÐµÐ½Ñ Ð¿Ð¾Ð´ÑÐ¾Ð´Ñ Ðº Ð¸Ð½ÑÐµÐ³ÑÐ°ÑÐ¸Ð¸ LLM Ð² Ð¿ÑÐ¾ÑÐµÑÑÑ Ð³ÐµÐ½ÐµÑÐ°ÑÐ¸Ð¸ ÐºÐ¾Ð´Ð° Ð´Ð»Ñ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ð½Ð¾Ð³Ð¾ ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ. ÐÐ° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð¿Ð¾Ð»ÑÑÐµÐ½Ð½ÑÑ Ð´Ð°Ð½Ð½ÑÑ, Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸ÐµÐ¼ Ð¼ÐµÑÐ¾Ð´Ð° ÑÐ¸Ð½ÑÐµÐ·Ð°, Ð¿ÑÐµÐ´Ð»Ð¾Ð¶ÐµÐ½Ð¾ ÑÐµÑÐµÐ½Ð¸Ðµ, Ð¾ÑÐ½Ð¾Ð²Ð°Ð½Ð½Ð¾Ðµ Ð½Ð° ÐºÐ¾Ð½ÑÐµÐ¿ÑÐ¸Ð¸ RAG, ÐºÐ¾ÑÐ¾ÑÐ¾Ðµ Ð½Ð°Ð¿ÑÐ°Ð²Ð»ÐµÐ½Ð¾ Ð½Ð° ÑÑÑÑÐ°Ð½ÐµÐ½Ð¸Ðµ Ð½ÐµÐ´Ð¾ÑÑÐ°ÑÐºÐ¾Ð² Ð¼Ð¾Ð´ÐµÐ»ÐµÐ¹, ÑÐ²ÑÐ·Ð°Ð½Ð½ÑÑ Ñ Ð¾Ð³ÑÐ°Ð½Ð¸ÑÐµÐ½Ð½Ð¾ÑÑÑÑ Ð¸ ÑÑÐ°ÑÐ¸ÑÐ½Ð¾ÑÑÑÑ ÐºÐ¾Ð½ÑÐµÐºÑÑÐ°. ÐÐ»Ñ Ð¿ÑÐ¾ÐµÐºÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Ð¸ ÑÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ð¸ Ð´Ð°Ð½Ð½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ Ð±ÑÐ» Ð¿ÑÐ¸Ð¼ÐµÐ½ÐµÐ½ Ð¾Ð±ÑÐµÐºÑÐ½Ð¾-Ð¾ÑÐ¸ÐµÐ½ÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð½ÑÐ¹ Ð¿Ð¾Ð´ÑÐ¾Ð´. Ð ÐµÐ·ÑÐ»ÑÑÐ°ÑÐ¾Ð¼Â  ÑÐ°Ð±Ð¾ÑÑ ÑÐ²Ð»ÑÐµÑÑÑ ÑÐ¸ÑÑÐµÐ¼Ð° Ð¿ÑÐµÐ´ÑÑÐ°Ð²Ð»ÑÐµÑ ÑÐ¾Ð±Ð¾Ð¹ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð¾Ðµ ÑÐµÑÐµÐ½Ð¸Ðµ, Ð¸ÑÐ¿Ð¾Ð»ÑÐ·ÑÑÑÐµÐµ LLM Ð¸ ÐºÐ¾Ð½ÑÐµÐ¿ÑÐ¸Ñ RAG, ÑÐ¿Ð¾ÑÐ¾Ð±Ð½Ð¾Ðµ Ð³ÐµÐ½ÐµÑÐ¸ÑÐ¾Ð²Ð°ÑÑ ÑÐµÑÑÑ Ñ ÑÑÐµÑÐ¾Ð¼ Ð¸Ð·Ð¼ÐµÐ½ÐµÐ½Ð¸Ð¹ Ð² ÐºÐ¾Ð´Ðµ Ð² Ð¿ÑÐ¾ÑÐµÑÑÐµ CI. Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½Ð°Ñ ÑÐ¸ÑÑÐµÐ¼Ð° Ð¾ÑÐ¸ÐµÐ½ÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð° Ð½Ð° Ð¿ÑÐ¸Ð¼ÐµÐ½ÐµÐ½Ð¸Ðµ Ð² Ð¾ÑÐ³Ð°Ð½Ð¸Ð·Ð°ÑÐ¸ÑÑ, Ð·Ð°Ð½Ð¸Ð¼Ð°ÑÑÐ¸ÑÑÑ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ¾Ð¹ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð¾Ð³Ð¾ Ð¾Ð±ÐµÑÐ¿ÐµÑÐµÐ½Ð¸Ñ, Ð³Ð´Ðµ ÑÑÐµÐ±ÑÐµÑÑÑ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð°ÑÐ¸Ñ ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ. ÐÐ½Ð° Ð¿Ð¾Ð·Ð²Ð¾Ð»ÑÐµÑ ÑÐ½Ð¸Ð·Ð¸ÑÑ Ð²ÑÐµÐ¼ÐµÐ½Ð½ÑÐµ Ð·Ð°ÑÑÐ°ÑÑ Ð½Ð° Ð½Ð°Ð¿Ð¸ÑÐ°Ð½Ð¸Ðµ ÑÐµÑÑÐ¾Ð² Ð¸ Ð°Ð´Ð°Ð¿ÑÐ¸ÑÐ¾Ð²Ð°ÑÑÑÑ Ðº Ð¸Ð·Ð¼ÐµÐ½ÐµÐ½Ð¸ÑÐ¼ Ð² ÐºÐ¾Ð´Ðµ.
description: The subject of the study is the technology of applying LLMs to automate software testing in the process of continuous integration. The purpose of this paper is to develop a software test automation system that uses suitable LLMs in the process of development of this software and continuous integration of updates to it. The study included a comparative analysis of existing test automation tools. Approaches to integrating LLMs into code generation processes for automated testing were studied. Based on the obtained data, using the synthesis method, a solution based on the RAG concept was proposed, which aims to eliminate the disadvantages of the models related to context constraints and staticity. An object-oriented approach was used to design and implement this system. The resulting system is a software solution utilizing LLM and the RAG concept, capable of generating tests taking into account the changes in the code during the CI process. The developed system is oriented for application in software development organizations where test automation is required. It allows reducing the time spent on writing tests and adapt to changes in the code.