julien-c
HF staff
commited on
Commit
283f66b
1 Parent(s): b6d9649

Migrate model card from transformers-repo

Browse files

Read announcement at https://discuss.huggingface.co/t/announcement-all-model-cards-will-be-migrated-to-hf-co-model-repos/2755
Original file history: https://github.com/huggingface/transformers/commits/master/model_cards/jannesg/bertsson/README.md

Files changed (1) hide show
  1. README.md +20 -0
README.md ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: sv
3
+ ---
4
+
5
+ # BERTSSON Models
6
+
7
+ The models are trained on:
8
+ - Government Text
9
+ - Swedish Literature
10
+ - Swedish News
11
+
12
+ Corpus size: Roughly 6B tokens.
13
+
14
+ The following models are currently available:
15
+
16
+ - **bertsson** - A BERT base model trained with the same hyperparameters as first published by Google.
17
+
18
+ All models are cased and trained with whole word masking.
19
+
20
+ Stay tuned for evaluations.