---
language: zh
tags:
- bert
- pytorch
widget:
- text: "巴黎是[MASK]国的首都。"
---
https://github.com/dbiir/UER-py/wiki/Modelzoo 中的

MixedCorpus+BertEncoder(large)+MlmTarget

https://share.weiyun.com/5G90sMJ

Pre-trained on mixed large Chinese corpus. The configuration file is bert_large_config.json


## 引用

```tex
@article{zhao2019uer,
  title={UER: An Open-Source Toolkit for Pre-training Models},
  author={Zhao, Zhe and Chen, Hui and Zhang, Jinbin and Zhao, Xin and Liu, Tao and Lu, Wei and Chen, Xi and Deng, Haotang and Ju, Qi and Du, Xiaoyong},
  journal={EMNLP-IJCNLP 2019},
  pages={241},
  year={2019}
}
```