wietsedv commited on
Commit
7a12a83
1 Parent(s): 410c6a3

add model card

Browse files
Files changed (1) hide show
  1. README.md +32 -0
README.md ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: fy
3
+ tags:
4
+ - BERTje
5
+ ---
6
+
7
+ Wietse de Vries • Martijn Bartelds • Malvina Nissim • Martijn Wieling
8
+
9
+ # Adapting Monolingual Models: Data can be Scarce when Language Similarity is High
10
+
11
+ This model is part of this paper + code:
12
+
13
+ - 📝 [Paper](https://arxiv.org/abs/2105.02855)
14
+ - 💻 [Code](https://github.com/wietsedv/low-resource-adapt)
15
+
16
+ ## Models
17
+
18
+ The best fine-tuned models for Gronings and West Frisian are available on the HuggingFace model hub:
19
+
20
+ ### Lexical layers
21
+ These models are identical to [BERTje](https://github.com/wietsedv/bertje), but with different lexical layers (`bert.embeddings.word_embeddings`).
22
+
23
+ - 🤗 [`GroNLP/bert-base-dutch-cased`](https://huggingface.co/GroNLP/bert-base-dutch-cased) (Dutch; source language)
24
+ - 🤗 [`GroNLP/bert-base-dutch-cased-gronings`](https://huggingface.co/GroNLP/bert-base-dutch-cased-gronings) (Gronings)
25
+ - 🤗 [`GroNLP/bert-base-dutch-cased-frisian`](https://huggingface.co/GroNLP/bert-base-dutch-cased-frisian) (West Frisian)
26
+
27
+ ### POS tagging
28
+ These models share the same fine-tuned Transformer layers + classification head, but with the retrained lexical layers from the models above.
29
+
30
+ - 🤗 [`GroNLP/bert-base-dutch-cased-upos-alpino`](https://huggingface.co/GroNLP/bert-base-dutch-cased-upos-alpino) (Dutch)
31
+ - 🤗 [`GroNLP/bert-base-dutch-cased-upos-alpino-gronings`](https://huggingface.co/GroNLP/bert-base-dutch-cased-upos-alpino-gronings) (Gronings)
32
+ - 🤗 [`GroNLP/bert-base-dutch-cased-upos-alpino-frisian`](https://huggingface.co/GroNLP/bert-base-dutch-cased-upos-alpino-frisian) (West Frisian)