1 ---
2 language: fy
3 tags:
4 - BERTje
5 ---
6
7 Wietse de Vries • Martijn Bartelds • Malvina Nissim • Martijn Wieling
8
9 # Adapting Monolingual Models: Data can be Scarce when Language Similarity is High
10
11 This model is part of this paper + code:
12
13 - 📝 [Paper](https://arxiv.org/abs/2105.02855)
14 - 💻 [Code](https://github.com/wietsedv/low-resource-adapt)
15
16 ## Models
17
18 The best fine-tuned models for Gronings and West Frisian are available on the HuggingFace model hub:
19
20 ### Lexical layers
21 These models are identical to [BERTje](https://github.com/wietsedv/bertje), but with different lexical layers (`bert.embeddings.word_embeddings`).
22
23 - 🤗 [`GroNLP/bert-base-dutch-cased`](https://huggingface.co/GroNLP/bert-base-dutch-cased) (Dutch; source language)
24 - 🤗 [`GroNLP/bert-base-dutch-cased-gronings`](https://huggingface.co/GroNLP/bert-base-dutch-cased-gronings) (Gronings)
25 - 🤗 [`GroNLP/bert-base-dutch-cased-frisian`](https://huggingface.co/GroNLP/bert-base-dutch-cased-frisian) (West Frisian)
26
27 ### POS tagging
28 These models share the same fine-tuned Transformer layers + classification head, but with the retrained lexical layers from the models above.
29
30 - 🤗 [`GroNLP/bert-base-dutch-cased-upos-alpino`](https://huggingface.co/GroNLP/bert-base-dutch-cased-upos-alpino) (Dutch)
31 - 🤗 [`GroNLP/bert-base-dutch-cased-upos-alpino-gronings`](https://huggingface.co/GroNLP/bert-base-dutch-cased-upos-alpino-gronings) (Gronings)
32 - 🤗 [`GroNLP/bert-base-dutch-cased-upos-alpino-frisian`](https://huggingface.co/GroNLP/bert-base-dutch-cased-upos-alpino-frisian) (West Frisian)
33