Don't shoot butterfly with rifles: Multi-channel Continuous Speech Separation with Early Exit Transformer
Journal: arXiv (Cornell University)
Year: 2020

With its strong modeling capacity that comes from a multi-head and multi-layer structure, Transformer is a very powerful model for learning a sequential representation and has been successfully applied to speech separation recently. However, multi-channel speech separation sometimes does not necessarily need such a heavy structure for all time frames especially when the cross-talker challenge happens only occasionally. For example, in conversation scenarios, most regions contain only a single ac