Hugging Face's logo

pnadel
/
palimpsestBERT

Fill-Mask
Transformers
Safetensors
Ancient Greek (to 1453)
bert
masked-lm
ancient-greek
Model card Files
xet
 Community

PalimpsestBERT

BERT-base continued-pretrained from GreekBERT (nlpaueb/bert-base-greek-uncased-v1) on a new Ancient Greek corpus derived from the Harvard institutional-books collection.

Pretraining

  • Best val loss: 1.5818, PPL: 4.864 (epoch 40/40)

Downstream (full results in the paper/repo)

TAG POS MORPH LEMMA UAS LAS SENT_F
98.66 98.64 94.95 94.40 87.85 84.47 74.01
Downloads last month
20
Safetensors
Model size
0.1B params
Tensor type
F32
·
Inference Providers NEW
Fill-Mask
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for pnadel/palimpsestBERT

Base model

nlpaueb/bert-base-greek-uncased-v1
Finetuned
(18)
this model

Dataset used to train pnadel/palimpsestBERT