Before revision:  Our experimental results show thatSynthesizer is competitive against vanilla Transformer models across a range of tasks, including MT (EnDe, EnFr), language modeling(LM1B), abstractive summarization (CNN/Dailymail), dialogue generation (PersonaChat) and Multi-task language understanding (GLUE, SuperGLUE ).
After revision:  Our experimental results show thatSynthesizer In our experiments, we first show that simple Synthesizers achieve highly competitive performance when compared against vanilla Transformer models across a range of tasks, including MT (EnDe, EnFr), language modeling(LM1B), abstractive summarization (CNN/Dailymail), dialogue generation (PersonaChat) and Multi-task language understanding (GLUE, SuperGLUE ).