Before revision:  Instead of utilizing explicit representations from pretraining in a self-supervised way , we utilizes transformer encoded hidden representations in a supervised way .
After revision:  Instead of utilizing explicit representations from pretraining in a self-supervised manner , we utilizes transformer encoded hidden representations in a supervised way .