Maltehb commited on
Commit
a56add8
1 Parent(s): 3203af4

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +39 -0
README.md ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: da
3
+ tags:
4
+ - danish
5
+ - bert
6
+ - masked-lm
7
+ - botxo
8
+ license: cc-by-4.0
9
+ datasets:
10
+ - common_crawl
11
+ - wikipedia
12
+ - dindebat.dk
13
+ - hestenettet.dk
14
+ - danish OpenSubtitles
15
+ pipeline_tag: fill-mask
16
+ widget:
17
+ - text: "København er [MASK] i Danmark."
18
+ ---
19
+
20
+ # Danish BERT (version 2, uncased) by [BotXO.ai](https://www.botxo.ai/)
21
+
22
+ All credit goes to [BotXO.ai](https://www.botxo.ai/) who developed Danish BERT. For data and training details see their [GitHub repository](https://github.com/botxo/nordic_bert) or [this article](https://www.botxo.ai/en/blog/danish-bert-model/).
23
+
24
+ It is both available in TensorFlow and Pytorch format.
25
+
26
+ The original TensorFlow version can be downloaded using [this link](https://www.dropbox.com/s/19cjaoqvv2jicq9/danish_bert_uncased_v2.zip?dl=1).
27
+
28
+
29
+ Here is an example on how to load Danish BERT in PyTorch using the [🤗Transformers](https://github.com/huggingface/transformers) library:
30
+
31
+
32
+
33
+ ```python
34
+ from transformers import AutoTokenizer, AutoModelForPreTraining
35
+
36
+ tokenizer = AutoTokenizer.from_pretrained("Maltehb/danish-bert-botxo")
37
+ model = AutoModelForPreTraining.from_pretrained("Maltehb/danish-bert-botxo")
38
+
39
+ ```