Before revision:  We show that this approach outperforms other methods with a similar number of trainable parameters on SST-2 and MNLI datasets.
After revision:  We show that this approach outperforms all existing methods with up to 25M trainable parameters on SST-2 and MNLI datasets.