Update README.md
Browse files
README.md
CHANGED
|
@@ -11,6 +11,8 @@ inference: false
|
|
| 11 |
|
| 12 |
SwissBERT is a masked language model for processing Switzerland-related text. It has been trained on more than 21 million Swiss news articles retrieved from [Swissdox@LiRI](https://t.uzh.ch/1hI).
|
| 13 |
|
|
|
|
|
|
|
| 14 |
SwissBERT is based on [X-MOD](https://huggingface.co/facebook/xmod-base), which has been pre-trained with language adapters in 81 languages.
|
| 15 |
For SwissBERT we trained adapters for the national languages of Switzerland – German, French, Italian, and Romansh Grischun.
|
| 16 |
In addition, we used a Switzerland-specific subword vocabulary.
|
|
|
|
| 11 |
|
| 12 |
SwissBERT is a masked language model for processing Switzerland-related text. It has been trained on more than 21 million Swiss news articles retrieved from [Swissdox@LiRI](https://t.uzh.ch/1hI).
|
| 13 |
|
| 14 |
+
<img src="https://raw.githubusercontent.com/ZurichNLP/swissbert/master/swissbert-diagram.png" alt="SwissBERT is a transformer encoder with language adapters in each layer. There is an adapter for each national language of Switzerland. The other parameters in the model are shared among the four languages." width="450" style="max-width: 100%;">
|
| 15 |
+
|
| 16 |
SwissBERT is based on [X-MOD](https://huggingface.co/facebook/xmod-base), which has been pre-trained with language adapters in 81 languages.
|
| 17 |
For SwissBERT we trained adapters for the national languages of Switzerland – German, French, Italian, and Romansh Grischun.
|
| 18 |
In addition, we used a Switzerland-specific subword vocabulary.
|