Label-Synchronous Neural Transducer for E2E Simultaneous Speech Translation
Year: 2024

While the neural transducer is popular for online speech recognition, simultaneous speech translation (SST) requires both streaming and re-ordering capabilities.This paper presents the LS-Transducer-SST, a label-synchronous neural transducer for SST, which naturally possesses these two properties.The LS-Transducer-SST dynamically decides when to emit translation tokens based on an Autoregressive Integrate-and-Fire (AIF) mechanism.A latency-controllable AIF is also proposed, which can control the