julien-c HF staff commited on
Commit
5189167
1 Parent(s): abed69c

Migrate model card from transformers-repo

Browse files

Read announcement at https://discuss.huggingface.co/t/announcement-all-model-cards-will-be-migrated-to-hf-co-model-repos/2755
Original file history: https://github.com/huggingface/transformers/commits/master/model_cards/ViktorAlm/electra-base-norwegian-uncased-discriminator/README.md

Files changed (1) hide show
  1. README.md +25 -0
README.md ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: no
3
+ thumbnail: https://i.imgur.com/QqSEC5I.png
4
+ ---
5
+
6
+ # Norwegian Electra
7
+ ![Image of norwegian electra](https://i.imgur.com/QqSEC5I.png)
8
+
9
+ Trained on Oscar + wikipedia + opensubtitles + some other data I had with the awesome power of TPUs(V3-8)
10
+
11
+ Use with caution. I have no downstream tasks in Norwegian to test on so I have no idea of its performance yet.
12
+ # Model
13
+ ## Electra: Pre-training Text Encoders as Discriminators Rather Than Generators
14
+ Kevin Clark and Minh-Thang Luong and Quoc V. Le and Christopher D. Manning
15
+ - https://openreview.net/pdf?id=r1xMH1BtvB
16
+ - https://github.com/google-research/electra
17
+ # Acknowledgments
18
+ ### TensorFlow Research Cloud
19
+ Research supported with Cloud TPUs from Google's TensorFlow Research Cloud (TFRC). Thanks for providing access to the TFRC ❤️
20
+ - https://www.tensorflow.org/tfrc
21
+ #### OSCAR corpus
22
+ - https://oscar-corpus.com/
23
+ #### OPUS
24
+ - http://opus.nlpl.eu/
25
+ - http://www.opensubtitles.org/