OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identification
Year: 2024

There has been an increasing interest in large speech models that can perform multiple tasks in a single model.Such models usually adopt an encoder-decoder or decoder-only architecture due to their popularity and good performance in many domains.However, autoregressive models can be slower during inference compared to non-autoregressive models and also have potential risks of hallucination.Though prior studies observed promising results of non-autoregressive models for certain tasks at small sca