Before revision:  The two modules are connected by a linear attention mechanism without parameters. A fully connected layer is introduced for  hidden mapping between speech and language modalities.
After revision:  The two modules are connected by a linear attention mechanism without additional parameters. Besides, a fully connected layer is introduced for hidden mapping between speech and language modalities.