julien-c HF staff commited on
Commit
c26c0bd
1 Parent(s): 9ad4cf8

Migrate model card from transformers-repo

Browse files

Read announcement at https://discuss.huggingface.co/t/announcement-all-model-cards-will-be-migrated-to-hf-co-model-repos/2755
Original file history: https://github.com/huggingface/transformers/commits/master/model_cards/deepset/gelectra-base/README.md

Files changed (1) hide show
  1. README.md +51 -0
README.md ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: de
3
+ license: mit
4
+ datasets:
5
+ - wikipedia
6
+ - OPUS
7
+ - OpenLegalData
8
+ ---
9
+
10
+ # German ELECTRA base
11
+
12
+ Released, Oct 2020, this is a German ELECTRA language model trained collaboratively by the makers of the original German BERT (aka "bert-base-german-cased") and the dbmdz BERT (aka bert-base-german-dbmdz-cased). In our [paper](https://arxiv.org/pdf/2010.10906.pdf), we outline the steps taken to train our model. Our evaluation suggests that this model is somewhat undertrained. For best performance from a base sized model, we recommend deepset/gbert-base
13
+
14
+ ## Overview
15
+ **Paper:** [here](https://arxiv.org/pdf/2010.10906.pdf)
16
+ **Architecture:** ELECTRA base (discriminator)
17
+ **Language:** German
18
+
19
+ ## Performance
20
+ ```
21
+ GermEval18 Coarse: 76.02
22
+ GermEval18 Fine: 42.22
23
+ GermEval14: 86.02
24
+ ```
25
+
26
+ See also:
27
+ deepset/gbert-base
28
+ deepset/gbert-large
29
+ deepset/gelectra-base
30
+ deepset/gelectra-large
31
+ deepset/gelectra-base-generator
32
+ deepset/gelectra-large-generator
33
+
34
+ ## Authors
35
+ Branden Chan: `branden.chan [at] deepset.ai`
36
+ Stefan Schweter: `stefan [at] schweter.eu`
37
+ Timo Möller: `timo.moeller [at] deepset.ai`
38
+
39
+ ## About us
40
+ ![deepset logo](https://raw.githubusercontent.com/deepset-ai/FARM/master/docs/img/deepset_logo.png)
41
+
42
+ We bring NLP to the industry via open source!
43
+ Our focus: Industry specific language models & large scale QA systems.
44
+
45
+ Some of our work:
46
+ - [German BERT (aka "bert-base-german-cased")](https://deepset.ai/german-bert)
47
+ - [FARM](https://github.com/deepset-ai/FARM)
48
+ - [Haystack](https://github.com/deepset-ai/haystack/)
49
+
50
+ Get in touch:
51
+ [Twitter](https://twitter.com/deepset_ai) | [LinkedIn](https://www.linkedin.com/company/deepset-ai/) | [Website](https://deepset.ai)