Efficient Monotonic Multihead Attention
Authors: name: Xutai Ma; name: Anna Sun; name: Siqi Ouyang; name: Hirofumi Inaguma; name: Paden Tomasello
Published: 2023-12-07 18:34:57

Abstract: We introduce the Efficient Monotonic Multihead Attention (EMMA), a
state-of-the-art simultaneous translation model with numerically-stable and
unbiased monotonic alignment estimation. In addition, we present improved
training and inference strategies, including simultaneous fine-tuning from an
offline translation model and reduction of monotonic alignment variance. The
experimental results demonstrate that the proposed model attains
state-of-the-art performance in simultaneous speech-to-text translation on the
Spanish and English translation task.