title: Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° ÑÐ¸ÑÑÐµÐ¼Ñ ÐºÐ¾Ð¼Ð¿ÑÑÑÐµÑÐ½Ð¾Ð³Ð¾ Ð·ÑÐµÐ½Ð¸Ñ Ð´Ð»Ñ ÑÐ¿ÑÐ°Ð²Ð»ÐµÐ½Ð¸Ñ Ð¼Ð¾ÑÑÐ¾Ð²ÑÐ¼ ÐºÑÐ°Ð½Ð¾Ð¼ Ð¿ÑÐ¸ Ð¿Ð¾Ð¼Ð¾ÑÐ¸ Ð¶ÐµÑÑÐ¾Ð²
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð±Ð°ÐºÐ°Ð»Ð°Ð²ÑÐ°
titleType: Subtitle
title: Development of a computer vision system for controlling an overhead crane using gestures
Creators: name: ÐÐ»Ð°ÑÑÑÐ¸Ð½, Ð Ð¾ÑÑÐ¸ÑÐ»Ð°Ð²
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2024
Subjects: Ð¼Ð¾ÑÑÐ¾Ð²Ð¾Ð¹ ÐºÑÐ°Ð½
ÐºÐ¾Ð¼Ð¿ÑÑÑÐµÑÐ½Ð¾Ðµ Ð·ÑÐµÐ½Ð¸Ðµ
Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ðµ Ð¾Ð±ÑÑÐµÐ½Ð¸Ðµ
Ð¶ÐµÑÑÐ¾Ð²ÑÐ¹ Ð¸Ð½ÑÐµÑÑÐµÐ¹Ñ
ÑÐ¿ÑÐ°Ð²Ð»ÐµÐ½Ð¸Ðµ
bridge crane
computer vision
machine learning
gestural interface
control

description: Ð¦ÐµÐ»ÑÑ Ð´Ð°Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÑ ÑÐ²Ð»ÑÐµÑÑÑÂ  Ð¿Ð¾Ð²ÑÑÐµÐ½Ð¸Ðµ ÑÑÑÐµÐºÑÐ¸Ð²Ð½Ð¾ÑÑÐ¸ ÑÐ¿ÑÐ°Ð²Ð»ÐµÐ½Ð¸Ñ Ð¼Ð¾ÑÑÐ¾Ð²ÑÐ¼ ÐºÑÐ°Ð½Ð¾Ð¼ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸Ñ Ð¿ÐµÑÐµÐ´Ð°ÑÐ¸ ÐºÐ¾Ð¼Ð°Ð½Ð´ Ð¿ÑÐ¸ Ð¿Ð¾Ð¼Ð¾ÑÐ¸ Ð¶ÐµÑÑÐ¾Ð². ÐÐ±ÑÐµÐºÑÐ¾Ð¼Â  ÑÐ¿ÑÐ°Ð²Ð»ÐµÐ½Ð¸ÑÂ  ÑÐ²Ð»ÑÐµÑÑÑÂ  Ð¼Ð¾ÑÑÐ¾Ð²Ð¾Ð¹Â  ÐºÑÐ°Ð½.Â  ÐÑÐµÐ´Ð¼ÐµÑÐ¾Ð¼Â  ÑÐ°Ð±Ð¾ÑÑÂ  ÑÐ²Ð»ÑÐµÑÑÑ ÑÐµÐ»Ð¾Ð²ÐµÐºÐ¾-Ð¼Ð°ÑÐ¸Ð½Ð½ÑÐ¹ Ð¸Ð½ÑÐµÑÑÐµÐ¹Ñ ÑÐ¿ÑÐ°Ð²Ð»ÐµÐ½Ð¸Ñ Ð¼Ð¾ÑÑÐ¾Ð²ÑÐ¼ ÐºÑÐ°Ð½Ð¾Ð¼ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð¶ÐµÑÑÐ¾Ð². ÐÐ°Ð´Ð°ÑÐ¸, ÐºÐ¾ÑÐ¾ÑÑÐµ ÑÐµÑÐ°Ð»Ð¸ÑÑ Ð² Ð¿ÑÐ¾ÑÐµÑÑÐµ Ð²ÑÐ¿Ð¾Ð»Ð½ÐµÐ½Ð¸Ñ ÑÐ°Ð±Ð¾ÑÑ: â Ð°Ð½Ð°Ð»Ð¸Ð· ÐºÐ¾Ð½ÑÑÑÑÐºÑÐ¸Ð¸ Ð¼Ð¾ÑÑÐ¾Ð²ÑÑ ÐºÑÐ°Ð½Ð¾Ð² Ð¸ Ð¼ÐµÑÐ¾Ð´Ð¸Ðº Ð¿Ð¾ ÑÐ¿ÑÐ°Ð²Ð»ÐµÐ½Ð¸Ñ Ð¸Ð¼Ð¸, â Ð°Ð½Ð°Ð»Ð¸Ð· Ð¸Ð¼ÐµÑÑÐ¸ÑÑÑ ÑÐµÑÐµÐ½Ð¸Ð¹ Ð¶ÐµÑÑÐ¾Ð²ÑÑ Ð¸Ð½ÑÐµÑÑÐµÐ¹ÑÐ¾Ð², â ÑÐ¾ÑÑÐ°Ð²Ð»ÐµÐ½Ð¸Ðµ ÑÑÑÑÐºÑÑÑÐ½Ð¾Ð¹ ÑÑÐµÐ¼Ñ ÑÐ¸ÑÑÐµÐ¼Ñ ÑÐ¿ÑÐ°Ð²Ð»ÐµÐ½Ð¸Ñ, â Ð½Ð°Ð¿Ð¸ÑÐ°Ð½Ð¸Ðµ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð° ÐºÐ»Ð°ÑÑÐ¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¸ Ð¶ÐµÑÑÐ¾Ð² Ð¿Ð¾ Ð²Ð¸Ð´ÐµÐ¾ÑÑÐ´Ñ Ñ ÐºÐ°Ð¼ÐµÑÑ, â ÑÐ¾ÑÑÐ°Ð²Ð»ÐµÐ½Ð¸Ðµ Ð¼Ð¾Ð´ÐµÐ»Ð¸ ÑÐµÐ»ÐµÐ¶ÐºÐ¸ Ð¼Ð¾ÑÑÐ¾Ð²Ð¾Ð³Ð¾ ÐºÑÐ°Ð½Ð° Ð² ÑÑÐµÐ´Ðµ Matlab Simulink, â Ð½Ð°ÑÑÑÐ¾Ð¹ÐºÐ°Â  Ð¿Ð°ÑÐ°Ð¼ÐµÑÑÐ¾Ð²Â  ÑÐµÐ³ÑÐ»ÑÑÐ¾ÑÐ°Â  Ð¿ÐµÑÐµÐ¼ÐµÑÐµÐ½Ð¸Ð¹Â  ÑÐµÐ»ÐµÐ¶ÐºÐ¸Â  Ð¼Ð¾ÑÑÐ¾Ð²Ð¾Ð³Ð¾ ÐºÑÐ°Ð½Ð°, â Ð¿ÑÐ¾Ð²ÐµÐ´ÐµÐ½Ð¸ÐµÂ  Ð²ÑÑÐ¸ÑÐ»Ð¸ÑÐµÐ»ÑÐ½ÑÑÂ  ÑÐºÑÐ¿ÐµÑÐ¸Ð¼ÐµÐ½ÑÐ¾Ð²Â  Ð´Ð»ÑÂ  Ð¿Ð¾Ð´ÑÐ²ÐµÑÐ¶Ð´ÐµÐ½Ð¸Ñ ÑÑÑÐµÐºÑÐ¸Ð²Ð½Ð¾ÑÑÐ¸ Ð¿ÑÐ¸Ð½ÑÑÑÑ ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ñ ÑÐµÑÐµÐ½Ð¸Ð¹. Ð Ð°Ð±Ð¾ÑÐ° Ð¿Ð¾ Ð¿ÑÐ¾ÐµÐºÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ ÑÐ¸ÑÑÐµÐ¼Ñ ÑÐ¿ÑÐ°Ð²Ð»ÐµÐ½Ð¸Ñ Ð²ÐºÐ»ÑÑÐ°Ð»Ð° Ð²Â  ÑÐµÐ±Ñ ÑÐ±Ð¾Ñ Ð´Ð°Ð½Ð½ÑÑ Ð¾Ð± ÑÑÑÐ°Ð½Ð¾Ð²ÐºÐµ, ÑÐ¾Ð·Ð´Ð°Ð½Ð¸Ðµ Ð½Ð°Ð±Ð¾ÑÐ° Ð´Ð°Ð½Ð½ÑÑ Ð´Ð»Ñ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ð¼Ð¾Ð´ÐµÐ»Ð¸ Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ,Â  Ð²ÑÐ±Ð¾ÑÂ  Ð¾Ð¿ÑÐ¸Ð¼Ð°Ð»ÑÐ½Ð¾Ð¹Â  Ð¼Ð¾Ð´ÐµÐ»Ð¸Â  Ð¸Â  ÐµÐµÂ  Ð½Ð°ÑÑÑÐ¾Ð¹ÐºÐ°,Â  Ð²ÑÐ±Ð¾ÑÂ  Ð¸Â  Ð½Ð°ÑÑÑÐ¾Ð¹ÐºÐ° Ð¿Ð°ÑÐ°Ð¼ÐµÑÑÐ¾Ð²Â  ÑÐµÐ³ÑÐ»ÑÑÐ¾ÑÐ°Â  Ð´Ð»ÑÂ  ÑÐ¿ÑÐ°Ð²Ð»ÐµÐ½Ð¸ÑÂ  Ð´Ð²Ð¸Ð¶ÐµÐ½Ð¸ÐµÐ¼Â  ÑÐµÐ»ÐµÐ¶ÐºÐ¸Â  ÐºÑÐ°Ð½Ð°Â  ÑÂ  Ð³ÑÑÐ·Ð¾Ð¼, Ð¿ÑÐ¾Ð²ÐµÑÐºÐ° ÑÐ°Ð±Ð¾ÑÐ¾ÑÐ¿Ð¾ÑÐ¾Ð±Ð½Ð¾ÑÑÐ¸ Ð¿ÑÐ¸ Ð¿Ð¾Ð¼Ð¾ÑÐ¸ ÑÐ¸Ð¼ÑÐ»ÑÑÐ¸Ð¸.
description: The purpose of this work is to improve the efficiency of overhead crane control based on the use of command transmission using gestures. The control object is an overhead crane. The subject of the work is a humanâmachine interface for controlling an overhead crane based on gestures. Tasks that were solved during the work: â analysis of the design of overhead cranes and methods for controlling them, â analysis of available solutions for gesture interfaces, â drawing up a block diagram of the control system, â writing an algorithm for classifying gestures based on video from the camera, â compiling a model of an overhead crane trolley in the Matlab Simulink environment, â setting the parameters of the movement controller of the overhead crane trolley, â conducting computational experiments to confirm the effectiveness of the applied technical solutions. The control system design work included collecting crane data, creating a data set to train a machine learning model, selecting the optimal model and tuning it, selecting and tuning controller parameters to control the movement of the crane truck with a load, and testing performance using simulation. As a result, a detailed analysis of overhead cranes and gesture interfaces was carried out, which made it possible to create algorithms for recognizing gestures and controlling the crane and testing their operation in the Matlab Simulink environment.