Edit model card

🚨 Notice: After re-checking this model again, it seems that the model is not working very well. E.g. MLM predictions are very likely to predict [UNK] token, which is actually not good.

We will update this model soon. For now, please use the bigscience-historical-texts/bert-base-blbooks-cased instead, as it was pretrained on the same corpus.

Downloads last month
24
Safetensors
Model size
111M params
Tensor type
I64
·
F32
·