MichelBartelsDeepset commited on
Commit
7a8202c
1 Parent(s): 83cb4ad

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +56 -0
README.md ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets:
3
+ - squad_v2
4
+ license: cc-by-4.0
5
+ ---
6
+
7
+ # bert-base-uncased for QA
8
+
9
+ ## Overview
10
+ **Language model:** roberta-base
11
+ **Language:** English
12
+ **Downstream-task:** Extractive QA
13
+ **Training data:** SQuAD 2.0
14
+ **Eval data:** SQuAD 2.0
15
+ **Infrastructure**: 1x Tesla v100
16
+
17
+ ## Hyperparameters
18
+
19
+ ```
20
+ batch_size = 32
21
+ n_epochs = 3
22
+ base_LM_model = "bert-base-uncased"
23
+ max_seq_len = 384
24
+ learning_rate = 3e-5
25
+ lr_schedule = LinearWarmup
26
+ warmup_proportion = 0.2
27
+ doc_stride=128
28
+ max_query_length=64
29
+ ```
30
+
31
+ ## Performance
32
+ ```
33
+ "exact": 73.67977764676156
34
+ "f1": 77.87647139308865
35
+ ```
36
+
37
+ ## Authors
38
+ - Timo Möller: `timo.moeller [at] deepset.ai`
39
+ - Julian Risch: `julian.risch [at] deepset.ai`
40
+ - Malte Pietsch: `malte.pietsch [at] deepset.ai`
41
+ - Michel Bartels: `michel.bartels [at] deepset.ai`
42
+ ## About us
43
+ ![deepset logo](https://workablehr.s3.amazonaws.com/uploads/account/logo/476306/logo)
44
+ We bring NLP to the industry via open source!
45
+ Our focus: Industry specific language models & large scale QA systems.
46
+
47
+ Some of our work:
48
+ - [German BERT (aka "bert-base-german-cased")](https://deepset.ai/german-bert)
49
+ - [GermanQuAD and GermanDPR datasets and models (aka "gelectra-base-germanquad", "gbert-base-germandpr")](https://deepset.ai/germanquad)
50
+ - [FARM](https://github.com/deepset-ai/FARM)
51
+ - [Haystack](https://github.com/deepset-ai/haystack/)
52
+
53
+ Get in touch:
54
+ [Twitter](https://twitter.com/deepset_ai) | [LinkedIn](https://www.linkedin.com/company/deepset-ai/) | [Slack](https://haystack.deepset.ai/community/join) | [GitHub Discussions](https://github.com/deepset-ai/haystack/discussions) | [Website](https://deepset.ai)
55
+
56
+ By the way: [we're hiring!](http://www.deepset.ai/jobs)