thatdramebaazguy commited on
Commit
2a0a3a4
1 Parent(s): 648c7e2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +43 -5
README.md CHANGED
@@ -1,7 +1,6 @@
1
  ---
2
  datasets:
3
- - squad
4
- - squad-v1
5
 
6
  language:
7
  - English
@@ -11,9 +10,48 @@ thumbnail:
11
  tags:
12
  - roberta
13
  - roberta-base
14
- - masked-language-modeling
15
- - masked-LM
 
 
16
 
17
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18
 
19
- Model Card coming soon!
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  datasets:
3
+ - SQuAD
 
4
 
5
  language:
6
  - English
 
10
  tags:
11
  - roberta
12
  - roberta-base
13
+ - question-answering
14
+ - qa
15
+
16
+ license: cc-by-4.0
17
 
18
  ---
19
+ # roberta-base + SQuAD QA
20
+
21
+ Objective:
22
+ This is Roberta Base trained to do the SQuAD Task. This makes a QA model capable of answering questions.
23
+
24
+ ```
25
+ model_name = "thatdramebaazguy/roberta-base-squad"
26
+ pipeline(model=model_name, tokenizer=model_name, revision="v1.0", task="question-answering")
27
+ ```
28
+
29
+ ## Overview
30
+ **Language model:** roberta-base
31
+ **Language:** English
32
+ **Downstream-task:** QA
33
+ **Training data:** SQuADv1
34
+ **Eval data:** SQuAD
35
+ **Infrastructure**: 2x Tesla v100
36
+ **Code:** See [example](https://github.com/adityaarunsinghal/Domain-Adaptation/blob/master/scripts/shell_scripts/train_movieR_just_squadv1.sh)
37
+
38
+ ## Hyperparameters
39
+ ```
40
+ Num examples = 88567
41
+ Num Epochs = 10
42
+ Instantaneous batch size per device = 32
43
+ Total train batch size (w. parallel, distributed & accumulation) = 64
44
 
45
+ ```
46
+ ## Performance
47
+
48
+ ### Eval on MoviesQA
49
+ - epoch = 10.0
50
+ - eval_samples = 10790
51
+ - exact_match = 83.6045
52
+ - f1 = 91.1709
53
+
54
+ Github Repo:
55
+ - [Domain-Adaptation Project](https://github.com/adityaarunsinghal/Domain-Adaptation/)
56
+
57
+ ---