GroNLP/bert-base-dutch-cased-upos-alpino

Wietse de Vries • Martijn Bartelds • Malvina Nissim • Martijn Wieling

Adapting Monolingual Models: Data can be Scarce when Language Similarity is High

This model is part of this paper + code:

• 📝 Paper
• 💻 Code

Models

The best fine-tuned models for Gronings and West Frisian are available on the HuggingFace model hub:

Lexical layers

These models are identical to BERTje, but with different lexical layers (bert.embeddings.word_embeddings).

• 🤗 GroNLP/bert-base-dutch-cased (Dutch; source language)
• 🤗 GroNLP/bert-base-dutch-cased-gronings (Gronings)
• 🤗 GroNLP/bert-base-dutch-cased-frisian (West Frisian)

POS tagging

These models share the same fine-tuned Transformer layers + classification head, but with the retrained lexical layers from the models above.

• 🤗 GroNLP/bert-base-dutch-cased-upos-alpino (Dutch)
• 🤗 GroNLP/bert-base-dutch-cased-upos-alpino-gronings (Gronings)
• 🤗 GroNLP/bert-base-dutch-cased-upos-alpino-frisian (West Frisian)