Tenth Meeting of the ACL Special Interest Group on Computational Morphology and Phonology

The performance of automatic speech recognition systems va ries widely across different contexts. Very good performance can be achieved on single-speaker, largevocabulary dictation in a clean acoustic environment, as well as on very small vocabulary tasks with much fewe r constraints on the speakers and acoustic conditions. In other domains, speech recognition is still f ar from usable for real-world applications. One domain that is still elusive is that of spontaneous conversa tion l speech. This type of speech poses a number of challenges, such as the presence of disfluencies, a mix of s peech and non-speech sounds such as laughter, and extreme variation in pronunciation. In this talk, I will focus on the challenge of pronunciation variation. A number of analyses suggest that this variability is respon ible for a large part of the drop in recognition performance between read (dictated) speech and conversati onal speech. I will describe efforts in the speech recognition community to characterize and model pronunciation variation, both for conversational speech and in general. T he work can be roughly divided into several types of approaches, including: augmentation of a phonetic pronu nciation lexicon with phonological rules; the use of large (syllableor word-sized) units instead of the more traditional phonetic ones; and the use of smaller units, such as distinctive or articulatory features. Of the se, the first is the most thoroughly studied and also the most disappointing: Despite successes in a few doma ins, it has been difficult to obtain significant recognition improvements by including in the lexicon those phonetic pronunciations that appear to exist in the data. In part as a reaction to this, many have advocated th e use of a “null pronunciation model,” i.e. a very limited lexicon including only canonical pronunciati ons. The assumption in this approach is that the observation model—the distribution of the acoustics given phonetic units—will better model the “noise” introduced by pronunciation variability. I will advocate an alternative view: that the phone unit may n ot be the most appropriate for modeling the lexicon. When considering a variety of pronunciation pheno mena, it becomes apparent that phonetic transcription often obscures some of the fundamental processes that are at play. I will describe approaches using both larger and “smaller” units. Larger units are typically syllables or words, and allow greater freedom to model the component states of each unit. In the class of “smal ler” unit models, ideas from articulatory and autosegmental phonology motivate multi-tier models in whi ch different features (or groups of features) have semi-independent behavior. I will present a particular mod el in which articulatory features are represented as variables in a dynamic Bayesian network. Non-phonetic pronunciation models can involve significant ly different model structures than those typically used in speech recognition, and as a result they may als o entail modifications to other components such as the observation model and training algorithms. At this po nt it is not clear what the “winning” approach will be. The success of a given approach may depend on the doma in or on the amount and type of training data available. I will describe some of the current challeng es and ongoing work, with a particular focus on the role of phonological theories in statistical models of p r nunciation (and vice versa? ).