madlag commited on
Commit
13eaf3e
1 Parent(s): 7cb4c4a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -1
README.md CHANGED
@@ -2,4 +2,38 @@
2
 
3
  F1 on dev (from paper)[https://arxiv.org/pdf/1810.04805v2.pdf] is 81.9, we reach 81.58.
4
 
5
- ```{'exact': 78.6321906847469,'f1': 81.5816656803201,'total': 11873,'HasAns_exact': 73.73481781376518, 'HasAns_f1': 79.64222615088413, 'HasAns_total': 5928, 'NoAns_exact': 83.51555929352396, 'NoAns_f1': 83.51555929352396, 'NoAns_total': 5945, 'best_exact': 78.6321906847469, 'best_exact_thresh': 0.0, 'best_f1': 81.58166568032006, 'best_f1_thresh': 0.0, 'epoch': 1.59}```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
 
3
  F1 on dev (from paper)[https://arxiv.org/pdf/1810.04805v2.pdf] is 81.9, we reach 81.58.
4
 
5
+ ```
6
+ {'exact': 78.6321906847469,
7
+ 'f1': 81.5816656803201,
8
+ 'total': 11873,
9
+ 'HasAns_exact': 73.73481781376518,
10
+ 'HasAns_f1': 79.64222615088413,
11
+ 'HasAns_total': 5928,
12
+ 'NoAns_exact': 83.51555929352396,
13
+ 'NoAns_f1': 83.51555929352396,
14
+ 'NoAns_total': 5945,
15
+ 'best_exact': 78.6321906847469,
16
+ 'best_exact_thresh': 0.0,
17
+ 'best_f1': 81.58166568032006,
18
+ 'best_f1_thresh': 0.0,
19
+ 'epoch': 1.59}
20
+ ```
21
+
22
+
23
+ ```
24
+ python run_qa.py \
25
+ --model_name_or_path bert-large-uncased \
26
+ --dataset_name squad_v2 \
27
+ --do_train \
28
+ --do_eval \
29
+ --save_steps 2500 \
30
+ --eval_steps 2500 \
31
+ --evaluation_strategy steps \
32
+ --per_device_train_batch_size 12 \
33
+ --learning_rate 3e-5 \
34
+ --num_train_epochs 2 \
35
+ --max_seq_length 384 \
36
+ --doc_stride 128 \
37
+ --output_dir bert-large-uncased-squadv2 \
38
+ --version_2_with_negative 1
39
+ ```