Before revision:  We evaluate CERT on three language understanding tasks : CoLA, RTE, and QNLI. CERT outperforms BERT significantly.
After revision:  We evaluate CERT on three language understanding tasks in the GLUE benchmark where CERT outperforms BERT on 7 tasks, achieves the same performance as BERT on 2 tasks, and performs worse than BERT on 2 tasks. On the averaged score of the 11 tasks, CERT outperforms BERT significantly.