COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining

This model card contains the COCO-LM model (base++ version) proposed in this paper. The official GitHub repository can be found here.


If you find this model card useful for your research, please cite the following paper:

  title={{COCO-LM}: Correcting and contrasting text sequences for language model pretraining},
  author={Meng, Yu and Xiong, Chenyan and Bajaj, Payal and Tiwary, Saurabh and Bennett, Paul and Han, Jiawei and Song, Xia},
Downloads last month
Hosted inference API

Unable to determine this model’s pipeline type. Check the docs .