๐Ÿšจ Notice: After re-checking this model again, it seems that the model is not working very well. E.g. MLM predictions are very likely to predict [UNK] token, which is actually not good.

We will update this model soon. For now, please use the bigscience-historical-texts/bert-base-blbooks-cased instead, as it was pretrained on the same corpus.

Downloads last month
11
Safetensors
Model size
111M params
Tensor type
I64
ยท
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support