Migrate model card from transformers-repo
Browse filesRead announcement at https://discuss.huggingface.co/t/announcement-all-model-cards-will-be-migrated-to-hf-co-model-repos/2755
Original file history: https://github.com/huggingface/transformers/commits/master/model_cards/ViktorAlm/electra-base-norwegian-uncased-discriminator/README.md
README.md
ADDED
@@ -0,0 +1,25 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language: no
|
3 |
+
thumbnail: https://i.imgur.com/QqSEC5I.png
|
4 |
+
---
|
5 |
+
|
6 |
+
# Norwegian Electra
|
7 |
+
![Image of norwegian electra](https://i.imgur.com/QqSEC5I.png)
|
8 |
+
|
9 |
+
Trained on Oscar + wikipedia + opensubtitles + some other data I had with the awesome power of TPUs(V3-8)
|
10 |
+
|
11 |
+
Use with caution. I have no downstream tasks in Norwegian to test on so I have no idea of its performance yet.
|
12 |
+
# Model
|
13 |
+
## Electra: Pre-training Text Encoders as Discriminators Rather Than Generators
|
14 |
+
Kevin Clark and Minh-Thang Luong and Quoc V. Le and Christopher D. Manning
|
15 |
+
- https://openreview.net/pdf?id=r1xMH1BtvB
|
16 |
+
- https://github.com/google-research/electra
|
17 |
+
# Acknowledgments
|
18 |
+
### TensorFlow Research Cloud
|
19 |
+
Research supported with Cloud TPUs from Google's TensorFlow Research Cloud (TFRC). Thanks for providing access to the TFRC ❤️
|
20 |
+
- https://www.tensorflow.org/tfrc
|
21 |
+
#### OSCAR corpus
|
22 |
+
- https://oscar-corpus.com/
|
23 |
+
#### OPUS
|
24 |
+
- http://opus.nlpl.eu/
|
25 |
+
- http://www.opensubtitles.org/
|