Speaker state recognition using an HMM-based feature extraction method
In this article we present an efficient approach to modeling the acoustic features for the tasks of recognizing various paralinguistic phenomena. Instead of the standard scheme of adapting the Universal Background Model (UBM). represented by the Gaussian Mixture Model (GMM), normally used to model the frame-level acoustic features, we propose to represent the UBM by building a monophone-based Hidden Markov Model (HMM). We present two approaches: transforming the monophone-based segmented HMM UBM to a GMM UBM and proceeding with the standard adaptation scheme, or to perform the adaptation directly on the HMM UBM. Both approaches give superior results than the standard adaptation scheme (GMM UBM) in both the emotion recognition task and the alcohol detection task. Furthermore, with the proposed method we were able to achieve better results than the current state-of-the-art systems in both tasks. (C) 2012 Elsevier Ltd. All rights reserved.
universal background model hidden markov models emotion recognition intoxication recognition model adaptation