Question: Why they conclude that the usage of Gated-Attention provides no competitive advantage against concatenation in this setting?
Answer: concatenation consistently outperforms the gated-attention mechanism for both training and testing instructions