title: Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð½ÐµÐ¹ÑÐ¾ÑÐµÑÐµÐ²Ð¾Ð¹ Ð¼Ð¾Ð´ÐµÐ»Ð¸ Ð¾Ð±Ð½Ð°ÑÑÐ¶ÐµÐ½Ð¸Ñ ÑÐµÑÐµÐ²Ð¾Ð¹ Ð°ÐºÑÐ¸Ð²Ð½Ð¾ÑÑÐ¸ Ð² Ð°ÐºÑÑÑÐ¸ÑÐµÑÐºÐ¾Ð¼ ÑÐ¸Ð³Ð½Ð°Ð»Ðµ Ñ Ð¿ÑÐ¸Ð¼ÐµÐ½ÐµÐ½Ð¸ÐµÐ¼ Ð°ÑÑ Ð¸ÑÐµÐºÑÑÑÑ ÑÑÐ°Ð½ÑÑÐ¾ÑÐ¼ÐµÑÐ¾Ð²
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¼Ð°Ð³Ð¸ÑÑÑÐ°
titleType: Subtitle
title: Development of a neural network model for detecting speech activity in an acoustic signal using the transformer architecture
Creators: name: ÐÐ¸ÑÐµÐ»ÐµÐ², ÐÐ»ÐµÐºÑÐ°Ð½Ð´Ñ
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2024
Subjects: Ð¾Ð±Ð½Ð°ÑÑÐ¶ÐµÐ½Ð¸Ðµ ÑÐµÑÐµÐ²Ð¾Ð¹ Ð°ÐºÑÐ¸Ð²Ð½Ð¾ÑÑÐ¸
Ð°ÑÑ Ð¸ÑÐµÐºÑÑÑÐ° ÑÑÐ°Ð½ÑÑÐ¾ÑÐ¼ÐµÑÐ¾Ð²
Ð°ÐºÑÑÑÐ¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ¸Ð³Ð½Ð°Ð»
Ð¼ÐµÐ»-ÑÐ°ÑÑÐ¾ÑÐ½ÑÐµ ÐºÐµÐ¿ÑÑÑÐ°Ð»ÑÐ½ÑÐµ ÐºÐ¾ÑÑÑÐ¸ÑÐ¸ÐµÐ½ÑÑ
ÑÐ¸Ð»ÑÑÑÑ ÑÐ¿ÐµÐºÑÑÐ¾-Ð²ÑÐµÐ¼ÐµÐ½Ð½Ð¾Ð¹ Ð¼Ð¾Ð´ÑÐ»ÑÑÐ¸Ð¸
voice activity detection
transformer architecture
acoustic signal
mel-frequency cepstral coefficients
filters of spectro-temporal modulation

description: Ð¦ÐµÐ»ÑÑ ÑÐ°Ð±Ð¾ÑÑ ÑÐ²Ð»ÑÐµÑÑÑ ÑÐ¾Ð·Ð´Ð°Ð½Ð¸Ðµ Ð½ÐµÐ¹ÑÐ¾ÑÐµÑÐµÐ²Ð¾Ð¹ Ð¼Ð¾Ð´ÐµÐ»Ð¸ Ð¾Ð±Ð½Ð°ÑÑÐ¶ÐµÐ½Ð¸Ñ ÑÐµÑÐµÐ²Ð¾Ð¹ Ð°ÐºÑÐ¸Ð²Ð½Ð¾ÑÑÐ¸ Ñ Ð¿ÑÐ¸Ð¼ÐµÐ½ÐµÐ½Ð¸ÐµÐ¼ Ð°ÑÑÐ¸ÑÐµÐºÑÑÑÑ ÑÑÐ°Ð½ÑÑÐ¾ÑÐ¼ÐµÑÐ¾Ð². ÐÐ»Ñ Ð´Ð¾ÑÑÐ¸Ð¶ÐµÐ½Ð¸Ñ ÑÐµÐ»Ð¸ Ð±ÑÐ»Ð¸ Ð¿Ð¾ÑÑÐ°Ð²Ð»ÐµÐ½Ñ ÑÐ»ÐµÐ´ÑÑÑÐ¸Ðµ Ð·Ð°Ð´Ð°ÑÐ¸: Ð¾Ð¿Ð¸ÑÐ°Ð½Ð¸Ðµ Ð¿ÑÐ¾Ð±Ð»ÐµÐ¼Ñ ÑÐ°Ð·Ð´ÐµÐ»ÐµÐ½Ð¸Ñ ÑÐµÑÐ¸ Ð¸ Ð·Ð²ÑÐºÐ°, Ð¾Ð±Ð·Ð¾Ñ Ð¾ÑÐ¾Ð±ÐµÐ½Ð½Ð¾ÑÑÐµÐ¹ Ð°ÐºÑÑÑÐ¸ÑÐµÑÐºÐ¸Ñ Ð¿ÑÐ¸Ð·Ð½Ð°ÐºÐ¾Ð² Ð°ÑÐ´Ð¸Ð¾ÑÐ¸Ð³Ð½Ð°Ð»Ð°, Ð²ÑÐ±Ð¾Ñ Ð°ÑÑÐ¸ÑÐµÐºÑÑÑÑ ÑÑÐ°Ð½ÑÑÐ¾ÑÐ¼ÐµÑÐ¾Ð² Ð¸ Ð°ÐºÑÑÑÐ¸ÑÐµÑÐºÐ¸Ñ Ð¿ÑÐ¸Ð·Ð½Ð°ÐºÐ¾Ð² Ð´Ð»Ñ Ð¼Ð¾Ð´ÐµÐ»Ð¸, Ð¾Ð±Ð·Ð¾Ñ Ð°Ð½Ð°Ð»Ð¾Ð³Ð¾Ð² Ð´Ð»Ñ Ð·Ð°Ð´Ð°ÑÐ¸ Ð¾Ð±Ð½Ð°ÑÑÐ¶ÐµÐ½Ð¸Ñ ÑÐµÑÐµÐ²Ð¾Ð¹ Ð°ÐºÑÐ¸Ð²Ð½Ð¾ÑÑÐ¸, Ð° ÑÐ°ÐºÐ¶Ðµ ÑÑÐ°Ð²Ð½ÐµÐ½Ð¸Ðµ Ð¿Ð¾Ð»ÑÑÐµÐ½Ð½Ð¾Ð¹ Ð¼Ð¾Ð´ÐµÐ»Ð¸ Ð¾Ð±Ð½Ð°ÑÑÐ¶ÐµÐ½Ð¸Ñ ÑÐµÑÐµÐ²Ð¾Ð¹ Ð°ÐºÑÐ¸Ð²Ð½Ð¾ÑÑÐ¸ Ñ Ð°Ð½Ð°Ð»Ð¾Ð³Ð°Ð¼Ð¸. Ð ÑÐ°Ð±Ð¾ÑÐµ Ð¿ÑÐ¸Ð²ÐµÐ´ÐµÐ½Ð¾ Ð¾Ð¿Ð¸ÑÐ°Ð½Ð¸Ðµ Ð¿ÑÐ¾Ð±Ð»ÐµÐ¼Ñ ÑÐ°Ð·Ð´ÐµÐ»ÐµÐ½Ð¸Ñ ÑÐµÑÐ¸ Ð¸ Ð·Ð²ÑÐºÐ°, Ð²ÑÐ¿Ð¾Ð»Ð½ÐµÐ½ Ð¾Ð±Ð·Ð¾Ñ Ð¾ÑÐ¾Ð±ÐµÐ½Ð½Ð¾ÑÑÐµÐ¹ Ð°ÐºÑÑÑÐ¸ÑÐµÑÐºÐ¸Ñ Ð¿ÑÐ¸Ð·Ð½Ð°ÐºÐ¾Ð² Ð°ÑÐ´Ð¸Ð¾ÑÐ¸Ð³Ð½Ð°Ð»Ð°. ÐÐ±Ð¾ÑÐ½Ð¾Ð²Ð°Ð½ Ð²ÑÐ±Ð¾Ñ Ð°ÑÑÐ¸ÑÐµÐºÑÑÑÑ ÑÑÐ°Ð½ÑÑÐ¾ÑÐ¼ÐµÑÐ¾Ð² Ð¸ Ð°ÐºÑÑÑÐ¸ÑÐµÑÐºÐ¸Ñ Ð¿ÑÐ¸Ð·Ð½Ð°ÐºÐ¾Ð² Ð´Ð»Ñ Ð¼Ð¾Ð´ÐµÐ»Ð¸. ÐÐ»Ñ Ð¼Ð¾Ð´ÐµÐ»Ð¸ Ð¿Ð¾Ð´Ð¾Ð±ÑÐ°Ð½Ñ Ð³Ð»Ð¾Ð±Ð°Ð»ÑÐ½ÑÐµ Ð¿Ð°ÑÐ°Ð¼ÐµÑÑÑ Ð¸ Ð¼ÐµÑÑÐ¸ÐºÐ¸ Ð¾ÑÐµÐ½ÐºÐ¸ ÐºÐ°ÑÐµÑÑÐ²Ð°. Ð ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐµ ÑÑÐ°Ð²Ð½ÐµÐ½Ð¸Ñ Ð¼Ð¾Ð´ÐµÐ»Ð¸ Ñ ÑÑÑÐµÑÑÐ²ÑÑÑÐ¸Ð¼Ð¸ Ð°Ð½Ð°Ð»Ð¾Ð³Ð°Ð¼Ð¸ Ð¾ÐºÐ°Ð·Ð°Ð»Ð¾ÑÑ, ÑÑÐ¾ Ð¼Ð¾Ð´ÐµÐ»Ñ Ð¾Ð±Ð»Ð°Ð´Ð°ÐµÑ Ð²ÑÑÐ¾ÐºÐ¸Ð¼Ð¸ Ð¿Ð¾ÐºÐ°Ð·Ð°ÑÐµÐ»ÑÐ¼Ð¸ Ð¼ÐµÑÑÐ¸ÐºÐ¸ F1, ÑÐ°Ð²Ð½Ð¾Ð¹ 0.94, Ð¼ÐµÑÑÐ¸ÐºÐ¸ ROC AUC, ÑÐ°Ð²Ð½Ð¾Ð¹ 0.94, Ð¸ Ð½Ð¸Ð·ÐºÐ¸Ð¼ Ð·Ð½Ð°ÑÐµÐ½Ð¸ÐµÐ¼ Ð¼ÐµÑÑÐ¸ÐºÐ¸ SDT, ÑÐ°Ð²Ð½Ð¾Ð¹ 19 Ð¼Ñ. ÐÐ¾Ð´ÐµÐ»Ñ Ð¼Ð¾Ð¶ÐµÑ Ð±ÑÑÑ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð° Ð´Ð»Ñ Ð½Ð°ÑÐ°Ð»ÑÐ½Ð¾Ð³Ð¾ ÑÑÐ°Ð¿Ð° Ð·Ð°Ð´Ð°ÑÐ¸ ÑÐ°ÑÐ¿Ð¾Ð·Ð½Ð°Ð²Ð°Ð½Ð¸Ñ ÑÐµÑÐ¸, Ð° ÑÐ°ÐºÐ¶Ðµ Ð² Ð³Ð¾Ð»Ð¾ÑÐ¾Ð²ÑÑ Ð¿Ð¾Ð¼Ð¾ÑÐ½Ð¸ÐºÐ°Ñ Ð¸ Ð² ÑÐ¸ÑÑÐµÐ¼Ð°Ñ Ð³Ð¾Ð»Ð¾ÑÐ¾Ð²Ð¾Ð³Ð¾ ÑÐ¿ÑÐ°Ð²Ð»ÐµÐ½Ð¸Ñ.
description: The aim of the work is to create a neural network model for detecting speech activity using the transformer architecture. To achieve this goal, the following tasks were set: a description of the problem of separation of speech and sound, an overview of the features of acoustic features of the audio signal, the choice of transformer architecture and acoustic features for the model, an overview of analogues for the task of detecting speech activity, as well as a comparison of the obtained model of detecting speech activity with analogues. The paper describes the problem of separation of speech and sound, and providesÂ  an overview of the features of the acoustic features of the audio signal. The choice of transformer architecture and acoustic features for the model is justified. Global parameters and quality assessment metrics have been selected for the model. As a result of comparing the model with existing analogues, it turned out that the model has high values of the F1 metric equal to 0.94, the ROC AUC metric equal to 0.94, and a low value of the SDT metric equal to 19 ms. The model can be used as an initial stage of the speech recognition task, as well as in voice assistants and voice control systems.