title: Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° ÑÑÐµÐ´ÑÑÐ² Ð¿Ð¾Ð´Ð´ÐµÑÐ¶Ð°Ð½Ð¸Ñ Ð±ÐµÑÐµÐ´Ñ Ð²Ð½Ðµ ÑÑÐµÐ½Ð°ÑÐ¸Ñ Ð´Ð»Ñ ÐºÐ¾ÑÐ¿Ð¾ÑÐ°ÑÐ¸Ð²Ð½Ð¾Ð³Ð¾ Ð´Ð¸Ð°Ð»Ð¾Ð³Ð¾Ð²Ð¾Ð³Ð¾ Ð°ÑÑÐ¸ÑÑÐµÐ½ÑÐ°
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð±Ð°ÐºÐ°Ð»Ð°Ð²ÑÐ°
titleType: Subtitle
title: Developing means of maintaining a talk outside scenario for a corporate dialogue assistant
Creators: name: ÐÐ»Ð°Ð´ÑÐºÐ¸Ð½Ð°, ÐÐ»Ð¸Ð·Ð°Ð²ÐµÑÐ°
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2020
Subjects: BERT
NLP
ÑÐ°ÑÐ±Ð¾Ñ
Ð¿ÑÐµÐ¼Ð¸Ñ Ð»ÐµÐ±Ð½ÐµÑÐ°
ÑÐµÑÑ ÑÑÑÑÐ¸Ð½Ð³Ð°
transformer
chatbot
lebner prize
turing test

description: Ð¦ÐµÐ»Ñ ÑÐ°Ð±Ð¾ÑÑ - ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ°, Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð°Ñ ÑÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ Ð¸ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ðµ Ð´Ð¸Ð°Ð»Ð¾Ð³Ð¾Ð²Ð¾Ð³Ð¾ Ð°ÑÑÐ¸ÑÑÐµÐ½ÑÐ°, Ð½Ð°Ð¸Ð±Ð¾Ð»ÐµÐµ Ð¾ÑÐ¼ÑÑÐ»ÐµÐ½Ð½Ð¾ Ð¿Ð¾Ð´Ð´ÐµÑÐ¶Ð¸Ð²Ð°ÑÑÐµÐ³Ð¾ Ð²ÑÑÐ¾Ð´ÑÑÐ¸Ð¹ Ð·Ð° ÑÐ°Ð¼ÐºÐ¸ ÑÑÐµÐ½Ð°ÑÐ¸Ñ Ð´Ð¸Ð°Ð»Ð¾Ð³ Ñ Ð¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°ÑÐµÐ»ÐµÐ¼. 
Ð ÑÐ¾Ð´Ðµ Ð¿ÑÐ¾Ð²ÐµÐ´ÐµÐ½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÑ Ð±ÑÐ»Ð° Ð¸Ð·ÑÑÐµÐ½Ð° Ð¿ÑÐµÐ´Ð¼ÐµÑÐ½Ð°Ñ Ð¾Ð±Ð»Ð°ÑÑÑ, Ð²ÑÐ±ÑÐ°Ð½Ñ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ñ Ð½Ð°ÑÐ¾Ð¶Ð´ÐµÐ½Ð¸Ñ Ð±Ð»Ð¸Ð·Ð¾ÑÑÐ¸ ÑÐµÐ¿Ð»Ð¸Ðº, Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ ÐµÑÑÐµÑÑÐ²ÐµÐ½Ð½Ð¾Ð³Ð¾ ÑÐ·ÑÐºÐ° Ð¸ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ð½ÐµÐ¹ÑÐ¾Ð½Ð½ÑÑ ÑÐµÑÐµÐ¹. 
ÐÐ»Ñ Ð¾ÑÐµÐ½ÐºÐ¸ Ð±Ð»Ð¸Ð·Ð¾ÑÑÐ¸ ÑÐµÐ¿Ð»Ð¸Ðº Ð¿ÑÐ¸Ð¼ÐµÐ½ÑÑÑÑÑ ÑÐ°Ð·Ð»Ð¸ÑÐ½ÑÐµ Ð¼ÐµÑÑÐ¸ÐºÐ¸, ÑÐµÐ°Ð»Ð¸Ð·Ð¾Ð²Ð°Ð½Ð½ÑÐµ ÐºÐ°Ðº Ð² Ð±Ð¸Ð±Ð»Ð¸Ð¾ÑÐµÐºÐµ, ÑÐ°Ðº Ð¸ Ð² Ð¿ÑÐ¾ÑÐµÑÑÐµ ÑÐ°Ð¼Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÑ: Ð¸Ð½Ð´ÐµÐºÑ ÐÐ°ÐºÐºÐ°ÑÐ°, ÑÐ°ÑÑÑÐ¾ÑÐ½Ð¸Ðµ ÐÐµÐ²ÐµÐ½ÑÑÐµÐ¹Ð½Ð°, Ð¼ÐµÑÑÐ¸ÐºÐ¸ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ ÑÐ¼Ð¾ÑÐ¸Ð¾Ð½Ð°Ð»ÑÐ½Ð¾Ð¹ Ð¸ ÑÐ°ÐºÑÐ¾Ð½Ð¾Ð¼Ð¸ÑÐµÑÐºÐ¾Ð¹ Ð±Ð»Ð¸Ð·Ð¾ÑÑÐ¸ ÑÐ»Ð¾Ð², Ð° ÑÐ°ÐºÐ¶Ðµ Ð¼ÐµÑÑÐ¸ÐºÐ°, Ð¾ÑÐ½Ð¾Ð²Ð°Ð½Ð½Ð°Ñ Ð½Ð° Ð¿ÑÐµÐ´ÑÐºÐ°Ð·Ð°Ð½Ð¸Ð¸ Ð¿ÑÐµÐ´Ð»Ð¾Ð¶ÐµÐ½Ð¸Ð¹ Ð½ÐµÐ¹ÑÐ¾ÑÐµÑÑÑ BERT. 
Ð ÑÐ¾Ð´Ðµ ÑÐ°Ð±Ð¾ÑÑ Ð±ÑÐ» ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½ Ð¼Ð¾Ð´ÑÐ»Ñ, Ð²ÐºÐ»ÑÑÐ°ÑÑÐ¸Ð¹ Ð°Ð´Ð°Ð¿ÑÐµÑÑ ÑÐ°Ð·Ð»Ð¸ÑÐ½ÑÑ Ð¼ÐµÑÐ¾Ð´Ð¾Ð² Ð¿Ð¾Ð¸ÑÐºÐ° Ð¾ÑÐ²ÐµÑÐ°, Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð±Ð¸Ð±Ð»Ð¸Ð¾ÑÐµÐºÐ¸ Chatterbot, Ð±ÑÐ»Ð° Ð´Ð¾Ð±Ð°Ð²Ð»ÐµÐ½Ð° Ð²Ð¾Ð·Ð¼Ð¾Ð¶Ð½Ð¾ÑÑÑ Ð²ÑÑÐ¸ÑÐ»ÐµÐ½Ð¸Ñ Ð±Ð»Ð¸Ð·Ð¾ÑÑÐ¸ ÑÐµÐ¿Ð»Ð¸Ðº Ñ Ð¿Ð¾Ð¼Ð¾ÑÑÑ Ð²ÐµÐºÑÐ¾ÑÐ½Ð¾Ð³Ð¾ Ð¿ÑÐµÐ´ÑÑÐ°Ð²Ð»ÐµÐ½Ð¸Ñ ÑÐµÐ¿Ð»Ð¸Ðº Ð¸ Ð´Ð°Ð»ÑÐ½ÐµÐ¹ÑÐµÐ¼ Ð½Ð°ÑÐ¾Ð¶Ð´ÐµÐ½Ð¸Ð¸ Ð²ÐµÑÐ¾ÑÑÐ½Ð¾ÑÑÐ¸ ÑÐ²ÑÐ·Ð½Ð¾ÑÑÐ¸ Ð¾ÑÐ²ÐµÑÐ° Ð½Ð° Ð½ÐµÐµ Ñ Ð²ÑÐ¾Ð´Ð½Ð¾Ð¹ ÑÐµÐ¿Ð»Ð¸ÐºÐ¾Ð¹. ÐÐ¾Ð»ÑÑÐµÐ½Ð½ÑÐ¹ Ð¼Ð¾Ð´ÑÐ»Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·ÑÐµÑ API Ð´Ð»Ñ Ð¿Ð¾Ð»ÑÑÐµÐ½Ð¸Ñ Ð¸ Ð¿ÐµÑÐµÐ´Ð°ÑÐ¸ ÑÐµÐ¿Ð»Ð¸Ðº Ð¸ ÑÐ¿Ð¾ÑÐ¾Ð±ÐµÐ½ Ð¸Ð½ÑÐµÐ³ÑÐ¸ÑÐ¾Ð²Ð°ÑÑÑÑ ÑÐµÑÐµÐ· Ð½ÐµÐ³Ð¾ Ñ Ð´ÑÑÐ³Ð¸Ð¼Ð¸ Ð¼Ð¾Ð´ÑÐ»ÑÐ¼Ð¸.
ÐÐ¾ ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐ°Ð¼ Ð¿ÑÐ¾Ð²ÐµÐ´ÐµÐ½Ð½ÑÑ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ð¹ Ð²ÑÑÐ²Ð»ÐµÐ½Ð¾ Ð¿ÑÐµÐ¸Ð¼ÑÑÐµÑÑÐ²Ð¾ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½Ð¾Ð¹ Ð¼ÐµÑÑÐ¸ÐºÐ¸ Ð¿Ð¾ ÑÑÐ°Ð²Ð½ÐµÐ½Ð¸Ñ Ñ Ð´ÑÑÐ³Ð¸Ð¼Ð¸, ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ðµ Ð¿ÑÐ¾Ð²Ð¾Ð´Ð¸Ð»Ð¾ÑÑ ÑÐºÑÐ¿ÐµÑÑÐ½Ð¾Ð¹ Ð¾ÑÐµÐ½ÐºÐ¾Ð¹ Ð¾ÑÐ²ÐµÑÐ¾Ð² Ð¼ÐµÑÐºÐ°Ð¼Ð¸ ÑÐ°Ð·ÑÐ¼Ð½Ð¾ÑÑÐ¸.
description: The purpose of the work is the development, software implementation and research of a dialogue assistant that most meaningfully supports a dialogue with the user that goes beyond the scope of the script. 
In the course of the work, the subject area was studied, algorithms were selected to find the proximity of replicas, process natural language and learn neural networks.
To measure the proximity of replicas, various metrics are used that are implemented both in the library and in the process: Jacquard index, Levenshtein distance, metrics based on the emotional and taxonomic proximity of words, and a metric based on prediction of sentences by the BERT neural network.
In the course of work, a module was developed, including adapters of various response search methods, based on the Chatterbot library, the ability to calculate the proximity of replicas using the vector representation of replicas and further finding the likelihood of a response to it with the input replica was added. The resulting module uses the API to receive and transmit replicas and is able to integrate through it with other modules.
According to the results of the studies, the advantage of the developed metric compared with others was revealed, testing was carried out by an expert evaluation of the answers with rationality marks.