Acoustic and lexical representations for affect prediction in spontaneous conversations ?
Study a variety of representations of lexical usage and acoustics for continuous affect recognition in spontaneous speech. We perform acoustic analysis on different regions of interest (ROI) and show substantial improvements. Lexical feature with sparse representation using mutual information between words and dimension as weights is powerful. Our proposed acoustic and lexical representations are complementary and show potential improvement for fusion. On the AVEC 2012, our approach outperforms other participants and baselines by a large margin.
acoustics affect spontaneous speech lexical features emotion