Released, Oct 2020, this is a German ELECTRA language model trained collaboratively by the makers of the original German BERT (aka "bert-base-german-cased") and the dbmdz BERT (aka bert-base-german-dbmdz-cased). In our paper, we outline the steps taken to train our model. Our evaluation suggests that this model is somewhat undertrained. For best performance from a base sized model, we recommend deepset/gbert-base
Architecture: ELECTRA base (discriminator) Language: German
GermEval18 Coarse: 76.02 GermEval18 Fine: 42.22 GermEval14: 86.02
deepset/gbert-base deepset/gbert-large deepset/gelectra-base deepset/gelectra-large deepset/gelectra-base-generator deepset/gelectra-large-generator
branden.chan [at] deepset.ai
stefan [at] schweter.eu
timo.moeller [at] deepset.ai
We bring NLP to the industry via open source!
Our focus: Industry specific language models & large scale QA systems.
Some of our work: