title: Ð Ð°ÑÐ¿Ð¾Ð·Ð½Ð°Ð²Ð°Ð½Ð¸Ðµ ÑÐ¼Ð¾ÑÐ¸Ð¾Ð½Ð°Ð»ÑÐ½Ð¾-Ð¿Ð¾Ð²ÐµÐ´ÐµÐ½ÑÐµÑÐºÐ¸Ñ Ð¿Ð°ÑÑÐµÑÐ½Ð¾Ð² Ð¿Ð¾ Ð¼Ð¸Ð¼Ð¸ÐºÐµ Ð»Ð¸ÑÐ° ÑÐµÐ»Ð¾Ð²ÐµÐºÐ° Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸ÐµÐ¼ Ð¼ÐµÑÐ¾Ð´Ð¾Ð² Ð³Ð»ÑÐ±Ð¾ÐºÐ¾Ð³Ð¾ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¼Ð°Ð³Ð¸ÑÑÑÐ°
titleType: Subtitle
title: Recognition of emotional and behavioral patterns by facial expressions of a person using deep learning methods
Creators: name: ÐÐ°Ð½Ð¸ÑÐ¸Ð½, ÐÐ³Ð¾ÑÑ
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2021
Subjects: Ð Ð°ÑÐ¿Ð¾Ð·Ð½Ð°Ð²Ð°Ð½Ð¸Ðµ Ð¾Ð±ÑÐ°Ð·Ð¾Ð²
ÐÑÑÐ¸ÑÐ»Ð¸ÑÐµÐ»ÑÐ½ÑÐµ Ð¼Ð°ÑÐ¸Ð½Ñ ÑÐ»ÐµÐºÑÑÐ¾Ð½Ð½ÑÐµ
Ð±Ð´Ð¸ÑÐµÐ»ÑÐ½Ð¾ÑÑÑ
ÑÐ¾Ð½Ð»Ð¸Ð²Ð¾ÑÑÑ
Ð°Ð»ÐºÐ¾Ð³Ð¾Ð»ÑÐ½Ð¾Ðµ Ð¾Ð¿ÑÑÐ½ÐµÐ½Ð¸Ðµ
Ð½Ð°ÑÐºÐ¾ÑÐ¸ÑÐµÑÐºÐ¾Ðµ Ð¾Ð¿ÑÑÐ½ÐµÐ½Ð¸Ðµ
ÑÐ°ÑÑÐ¾ÑÐ° Ð·Ð°ÐºÑÑÑÐ¸Ñ Ð³Ð»Ð°Ð·
ÑÐ¾Ð¾ÑÐ½Ð¾ÑÐµÐ½Ð¸Ðµ ÑÑÐ¾ÑÐ¾Ð½ Ð³Ð»Ð°Ð·
Ð¿ÑÐ¿Ð¸Ð»Ð»Ð¾Ð¼ÐµÑÑÐ¸Ñ
ÑÐµÑÐ¼Ð¾Ð³ÑÐ°ÑÐ¸Ñ
Ð¸ÑÐºÑÑÑÑÐ²ÐµÐ½Ð½ÑÐµ Ð½ÐµÐ¹ÑÐ¾Ð½Ð½ÑÐµ ÑÐµÑÐ¸
Ð»Ð¾Ð³Ð¸ÑÑÐ¸ÑÐµÑÐºÐ°Ñ ÑÐµÐ³ÑÐµÑÑÐ¸Ñ
Ð´ÐµÑÐµÐ²ÑÑ ÑÐµÑÐµÐ½Ð¸Ð¹

description: ÐÐ°Ð³Ð¸ÑÑÐµÑÑÐºÐ°Ñ Ð´Ð¸ÑÑÐµÑÑÐ°ÑÐ¸Ñ Ð¿Ð¾ÑÐ²ÑÑÐµÐ½Ð° ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐµ ÑÐ¸ÑÑÐµÐ¼Ñ Ð¿ÑÐµÐ´ÑÐ¿ÑÐµÐ¶Ð´ÐµÐ½Ð¸Ñ Ð²Ð¾Ð´Ð¸ÑÐµÐ»Ñ Ð¾ Ð²Ð¾Ð·Ð½Ð¸ÐºÐ½Ð¾Ð²ÐµÐ½Ð¸Ð¸ Ð´Ð¾ÑÐ¾Ð¶Ð½Ð¾-ÑÑÐ°Ð½ÑÐ¿Ð¾ÑÑÐ½ÑÑ Ð¿ÑÐ¾Ð¸ÑÑÐµÑÑÐ²Ð¸Ð¹ Ð¿ÑÑÐµÐ¼ Ð²ÑÑÐ²Ð»ÐµÐ½Ð¸Ñ ÐµÐ³Ð¾ ÑÐ¼Ð¾ÑÐ¸Ð¾Ð½Ð°Ð»ÑÐ½Ð¾Ð³Ð¾ ÑÐ¾ÑÑÐ¾ÑÐ½Ð¸Ñ Ð½Ð° Ð²Ð¸Ð´ÐµÐ¾Ð¿Ð¾ÑÐ¾ÐºÐµ. Ð ÑÐ°Ð±Ð¾ÑÐµ Ð¿ÑÐ¾Ð²ÐµÐ´ÑÐ½ Ð°Ð½Ð°Ð»Ð¸Ð· Ð°Ð½Ð°Ð»Ð¾Ð³Ð¾Ð² ÑÐ°Ð·ÑÐ°Ð±Ð°ÑÑÐ²Ð°ÐµÐ¼Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ, Ð¼ÐµÑÐ¾Ð´Ð¾Ð² ÑÐµÑÐµÐ½Ð¸Ñ Ð·Ð°Ð´Ð°Ñ ÑÐ°ÑÑÑÑÐ° Ð¿Ð¾ÐºÐ°Ð·Ð°ÑÐµÐ»ÐµÐ¹ Ð¾ÑÑÑÑÑÑÐ²Ð¸Ñ Ð±Ð´Ð¸ÑÐµÐ»ÑÐ½Ð¾ÑÑÐ¸, Ð¾ÑÐµÐ½ÐºÐ¸ ÑÐ¼Ð¾ÑÐ¸Ð¾Ð½Ð°Ð»ÑÐ½Ð¾Ð³Ð¾ ÑÐ¾ÑÑÐ¾ÑÐ½Ð¸Ñ Ð²Ð¾Ð´Ð¸ÑÐµÐ»Ñ. Ð ÑÐ¾Ð´Ðµ ÑÐ°Ð±Ð¾ÑÑ Ð±ÑÐ»Ð¾ Ð¿ÑÐ¾Ð²ÐµÐ´ÐµÐ½Ð¾ Ð¿ÑÐ¾ÐµÐºÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ðµ Ð¸ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð°ÑÑÐ¸ÑÐµÐºÑÑÑÑ ÑÐ¸ÑÑÐµÐ¼Ñ, Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² ÑÐ°ÑÑÑÑÐ° Ð¿Ð¾ÐºÐ°Ð·Ð°ÑÐµÐ»ÐµÐ¹ Ð¾ÑÑÑÑÑÑÐ²Ð¸Ñ Ð±Ð´Ð¸ÑÐµÐ»ÑÐ½Ð¾ÑÑÐ¸ Ñ Ð²Ð¾Ð´Ð¸ÑÐµÐ»Ñ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð¼ÐµÑÐ¾Ð´Ð¾Ð² ÑÐ°ÑÑÑÑÐ° Ð¿Ð¾ÐºÐ°Ð·Ð°ÑÐµÐ»Ñ ÑÑÑÐ°Ð»Ð¾ÑÑÐ¸ PERCLOS Ð¸ Ð¿ÑÐ¿Ð¸Ð»Ð»Ð¾Ð¼ÐµÑÑÐ¸ÑÐµÑÐºÐ¾Ð³Ð¾ Ð¿Ð¾Ð´ÑÐ¾Ð´Ð°, Ð½Ð°Ð¿ÑÐ°Ð²Ð»ÐµÐ½Ð½Ð¾Ð³Ð¾ Ð½Ð° Ð¾Ð¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð¸Ðµ ÑÐ¾ÑÑÐ¾ÑÐ½Ð¸Ð¹ Ð°Ð»ÐºÐ¾Ð³Ð¾Ð»ÑÐ½Ð¾Ð³Ð¾ Ð¸ Ð½Ð°ÑÐºÐ¾ÑÐ¸ÑÐµÑÐºÐ¾Ð³Ð¾ Ð¾Ð¿ÑÑÐ½ÐµÐ½Ð¸Ð¹, Ð¸ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð° Ð¾ÑÐµÐ½ÐºÐ¸ ÑÐ¼Ð¾ÑÐ¸Ð¾Ð½Ð°Ð»ÑÐ½Ð¾Ð³Ð¾ ÑÐ¾ÑÑÐ¾ÑÐ½Ð¸Ñ Ð²Ð¾Ð´Ð¸ÑÐµÐ»Ñ. Ð­ÐºÑÐ¿ÐµÑÐ¸Ð¼ÐµÐ½ÑÐ°Ð»ÑÐ½Ð¾Ðµ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ðµ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ Ð¿ÑÐ¾Ð²Ð¾Ð´Ð¸ÑÑÑ Ð½Ð° ÑÐ¸Ð½ÑÐµÑÐ¸ÑÐµÑÐºÐ¸Ñ Ð´Ð°Ð½Ð½ÑÑ Ð¸ ÑÐµÐ°Ð»ÑÐ½ÑÑ Ð´Ð°Ð½Ð½ÑÑ, ÐºÐ¾ÑÐ¾ÑÐ¾Ðµ Ð¿Ð¾Ð´ÑÐ²ÐµÑÐ¶Ð´Ð°ÐµÑ Ð¾Ð¶Ð¸Ð´Ð°ÐµÐ¼ÑÐµ ÐºÐ°ÑÐµÑÑÐ²Ð¾ ÑÐ°Ð±Ð¾ÑÑ Ð¸ ÐºÐ¾ÑÑÐµÐºÑÐ½ÑÑ ÑÐ°Ð±Ð¾ÑÐ¾ÑÐ¿Ð¾ÑÐ¾Ð±Ð½Ð¾ÑÑÑ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ.
description: The master's thesis is devoted to the development of a system for warning the driver about the occurrence of road accidents by identifying the emotional state of a person by his facial expressions on the video stream. The paper analyzes the analogues of the developed system, methods and approaches used in solving the problems of calculating the indicators of lack of vigilance in the driver and assessing his emotional state. In the course of the work, the design and development of the system architecture, algorithms for determining the indicators of lack of vigilance in the driver based on the method of calculating the fatigue index PERCLOS and the pupillometric approach aimed at determining the states of alcohol and drug intoxication, and the algorithm for assessing the emotional state of the driver were carried out. The experimental study of the developed system is carried out both on synthetic data and on real data, which confirms the expected quality of work and the correct performance of the developed system.