orai-nlp
/

bert-base-sw

Feature Extraction

Inference Endpoints

text-embeddings-inference

Model card Files Files and versions Community

GorkaUrbizu commited on May 31, 2023

Commit

a13f385

•

1 Parent(s): b0e3850

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -8,7 +8,7 @@ language:
 BERT base (cased) model trained on a subset of 125M tokens of cc100-Swahili for our work [Scaling Laws for BERT in Low-Resource Settings]() at ACL2023 Findings.
 The model has 124M parameters (12L), and a vocab size of 50K.
-It was trained for 500K steps with a sequence length of 512 tokens.
 Results
 -----------

 BERT base (cased) model trained on a subset of 125M tokens of cc100-Swahili for our work [Scaling Laws for BERT in Low-Resource Settings]() at ACL2023 Findings.
 The model has 124M parameters (12L), and a vocab size of 50K.
+It was trained for 500K steps with a sequence length of 512 tokens and batch-size of 256.
 Results
 -----------