---
license: cc-by-nc-sa-4.0
datasets:
- wikipedia
- bookcorpus
language:
- en
library_name: transformers
pipeline_tag: fill-mask
---

This is the pretrained model of First 2 Chars. Please refer to our [GitHub](https://github.com/hitachi-nlp/mlm-probe-acl2023) page for more details.