title: Ð ÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ñ Ð¿Ð¾Ð´ÐºÑÐµÐ¿Ð»ÐµÐ½Ð¸ÐµÐ¼ Ð´Ð»Ñ ÑÐ¾ÑÐ¼Ð¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Ð¿ÐµÑÑÐ¾Ð½Ð°Ð»Ð¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ð½ÑÑ ÑÐµÐºÐ¾Ð¼ÐµÐ½Ð´Ð°ÑÐ¸Ð¹
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð±Ð°ÐºÐ°Ð»Ð°Ð²ÑÐ°
titleType: Subtitle
title: Implementation of reinforcement learning algorithms for the formation of personalized recommendations
Creators: name: ÐÐ¸Ð¼ÐµÐ½Ð¾Ð²Ð°, Ð¢Ð°ÑÑÑÐ½Ð°
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2022
Subjects: Ð·Ð°Ð´Ð°ÑÐ° Ð¼Ð½Ð¾Ð³Ð¾ÑÑÐºÐ¾Ð³Ð¾ Ð±Ð°Ð½Ð´Ð¸ÑÐ°
ÑÐµÐºÐ¾Ð¼ÐµÐ½Ð´Ð°ÑÐ¸Ð¸
Ð°Ð³ÐµÐ½Ñ
Ð´ÐµÐ¹ÑÑÐ²Ð¸Ðµ
Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼
Ð¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°ÑÐµÐ»Ñ
multi-armed bandit problem
recommendations
agent
action
algorithm
user

description: Ð¢ÐµÐ¼Ð° Ð²ÑÐ¿ÑÑÐºÐ½Ð¾Ð¹ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÑ: Â«Ð ÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ñ Ð¿Ð¾Ð´ÐºÑÐµÐ¿Ð»ÐµÐ½Ð¸ÐµÐ¼ Ð´Ð»Ñ ÑÐ¾ÑÐ¼Ð¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Ð¿ÐµÑÑÐ¾Ð½Ð°Ð»Ð¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ð½ÑÑ ÑÐµÐºÐ¾Ð¼ÐµÐ½Ð´Ð°ÑÐ¸Ð¹Â». ÐÐ°Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¿Ð¾ÑÐ²ÑÑÐµÐ½Ð° Ð¿ÑÐ¸Ð¼ÐµÐ½ÐµÐ½Ð¸Ñ Ð¼ÐµÑÐ¾Ð´Ð¾Ð² ÑÐµÑÐµÐ½Ð¸Ñ Ð·Ð°Ð´Ð°ÑÐ¸ Ð¾ Ð¼Ð½Ð¾Ð³Ð¾ÑÑÐºÐ¾Ð¼ Ð±Ð°Ð½Ð´Ð¸ÑÐµ Ð´Ð»Ñ ÑÐ²ÐµÐ»Ð¸ÑÐµÐ½Ð¸Ñ ÑÑÐ¾Ð²Ð½Ñ ÑÐ´Ð¾Ð²Ð»ÐµÑÐ²Ð¾ÑÐµÐ½Ð½Ð¾ÑÑÐ¸ Ð²ÐµÐ±-ÑÐ°Ð¹ÑÐ¾Ð¼ Ð¿Ð¾ Ð¿ÑÐ¾Ð´Ð°Ð¶Ðµ ÐºÐ½Ð¸Ð³ Ð¿ÑÑÐµÐ¼ ÑÐ¾ÑÐ¼Ð¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ ÑÐµÐºÐ¾Ð¼ÐµÐ½Ð´Ð°ÑÐ¸Ð¹ Ñ ÑÑÐµÑÐ¾Ð¼ Ð´ÐµÐ¹ÑÑÐ²Ð¸Ð¹ Ð¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°ÑÐµÐ»Ñ. ÐÐ°Ð´Ð°ÑÐ¸, ÐºÐ¾ÑÐ¾ÑÑÐµ ÑÐµÑÐ°Ð»Ð¸ÑÑ Ð² ÑÐ¾Ð´Ðµ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ:1. ÐÐ·ÑÑÐµÐ½Ð¸Ðµ Ð¾ÑÐ¾Ð±ÐµÐ½Ð½Ð¾ÑÑÐµÐ¹ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ñ Ð¿Ð¾Ð´ÐºÑÐµÐ¿Ð»ÐµÐ½Ð¸ÐµÐ¼ Ð¸, Ð² ÑÐ°ÑÑÐ½Ð¾ÑÑÐ¸, Ð·Ð°Ð´Ð°ÑÐ¸ Ð¾ Ð¼Ð½Ð¾Ð³Ð¾ÑÑÐºÐ¾Ð¼ Ð±Ð°Ð½Ð´Ð¸ÑÐµ.2. ÐÑÑÐ²Ð»ÐµÐ½Ð¸Ðµ Ð½Ð°Ð¸Ð±Ð¾Ð»ÐµÐµ ÑÐ°ÑÑÐ¾ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·ÑÐµÐ¼ÑÑ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð´Ð»Ñ ÑÐµÑÐµÐ½Ð¸Ñ Ð´Ð°Ð½Ð½Ð¾Ð¹ Ð·Ð°Ð´Ð°ÑÐ¸.3. ÐÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ðµ Ð¿ÑÐ¾Ð±Ð»ÐµÐ¼Ñ ÑÐµÐºÐ¾Ð¼ÐµÐ½Ð´Ð°ÑÐ¸Ð¹ Ð¸ ÑÐ¿Ð¾ÑÐ¾Ð±Ð¾Ð² Ð¸Ñ ÑÐ¾ÑÐ¼Ð¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ.4. Ð ÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ Ð²ÑÐ±ÑÐ°Ð½Ð½ÑÑ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð´Ð»Ñ ÑÐ¾ÑÐ¼Ð¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ ÑÐµÐºÐ¾Ð¼ÐµÐ½Ð´Ð°ÑÐ¸Ð¹ Ð½Ð° Ð²ÐµÐ±-ÑÐ°Ð¹ÑÐµ Ð¿Ð¾ Ð¿ÑÐ¾Ð´Ð°Ð¶Ðµ ÐºÐ½Ð¸Ð³.5. ÐÐ½Ð°Ð»Ð¸Ð· ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐ¾Ð² ÑÐ°Ð±Ð¾ÑÑ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð¸ ÑÐµÐºÐ¾Ð¼ÐµÐ½Ð´Ð°ÑÐ¸Ð¸ Ð¿Ð¾ Ð´Ð°Ð»ÑÐ½ÐµÐ¹ÑÐµÐ¼Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸Ñ. Ð Ð°Ð±Ð¾ÑÐ° Ð¾ÑÑÑÐµÑÑÐ²Ð»ÐµÐ½Ð° Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð½Ð°Ð±Ð¾ÑÐ° Ð´Ð°Ð½Ð½ÑÑ Â«Book Recommendation SystemÂ» (Ð°Ð½Ð³Ð». ÐÐ½Ð¸Ð¶Ð½Ð°Ñ ÑÐµÐºÐ¾Ð¼ÐµÐ½Ð´Ð°ÑÐµÐ»ÑÐ½Ð°Ñ ÑÐ¸ÑÑÐµÐ¼Ð°). Ð­ÐºÑÐ¿ÐµÑÐ¸Ð¼ÐµÐ½Ñ Ð¿ÑÐ¾Ð²Ð¾Ð´Ð¸Ð»ÑÑ Ð² ÑÑÐµÐ´Ðµ Google Colab, Ð³Ð´Ðµ Ð±ÑÐ» Ð½Ð°Ð¿Ð¸ÑÐ°Ð½ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½ÑÐ¹ ÐºÐ¾Ð´ Ð½Ð° ÑÐ·ÑÐºÐµ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Python. Ð ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐµ Ð±ÑÐ»Ð¸ Ð¿ÑÐ¾Ð²ÐµÐ´ÐµÐ½Ñ ÑÐ°ÑÑÐµÑÑ, Ð¿Ð¾ÐºÐ°Ð·ÑÐ²Ð°ÑÑÐ¸Ðµ Ð¼ÐµÐ½ÑÑÑÐ¸ÐµÑÑ ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÑ ÑÐµÐºÐ¾Ð¼ÐµÐ½Ð´Ð°ÑÐ¸Ð¹ Ð² Ð·Ð°Ð²Ð¸ÑÐ¸Ð¼Ð¾ÑÑÐ¸ Ð¾Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·ÑÐµÐ¼ÑÑ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð¸ Ð¸Ñ Ð¿Ð°ÑÐ°Ð¼ÐµÑÑÐ¾Ð². ÐÑÐ¾Ð²ÐµÐ´ÐµÐ½ ÑÑÐ°Ð²Ð½Ð¸ÑÐµÐ»ÑÐ½ÑÐ¹ Ð°Ð½Ð°Ð»Ð¸Ð· Ð¸ ÑÑÐ¾ÑÐ¼Ð¸ÑÐ¾Ð²Ð°Ð½Ñ ÑÐµÐºÐ¾Ð¼ÐµÐ½Ð´Ð°ÑÐ¸Ð¸ Ð¿Ð¾ Ð¿ÑÐ¸Ð¼ÐµÐ½ÐµÐ½Ð¸Ñ Ð²ÑÐ±ÑÐ°Ð½Ð½ÑÑ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð¸ ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐ¾Ð² Ð¸Ñ ÑÐ°Ð±Ð¾ÑÑ.
description: Topic of the final qualification work: "Implementation of reinforcement learning algorithms for the formation of personalized recommendations". This work is devoted to the application of methods for solving the problem of the multi-armed bandit to increase the level of satisfaction with the website for the sale of books by generating recommendations based on user actions. The tasks solved in the course of the study:1. Studying the features of reinforcement learning and the multi-armed bandit problem.2. Identification of the most used algorithms for solving this problem.3. Study of the problem of recommendations and ways of their formation.4. Implementation of the selected algorithms for the formation of recommendations on the website for the sale of books.5. Analysis of the results of the algorithms and recommendations for further use. The work was carried out based on the âBook Recommendation Systemâ dataset. The experiment was carried out in the Google Colab environment, where the program code was written in the Python programming language.As a result, calculations were made showing the changing results of the recommendations depending on the algorithms used and their parameters. A comparative analysis was carried out and recommendations were made for the application of the selected algorithms and the results of their work.