julien-c HF staff commited on
Commit
2d60aa0
1 Parent(s): 8ea89d4

Migrate model card from transformers-repo

Browse files

Read announcement at https://discuss.huggingface.co/t/announcement-all-model-cards-will-be-migrated-to-hf-co-model-repos/2755
Original file history: https://github.com/huggingface/transformers/commits/master/model_cards/NeuML/bert-small-cord19-squad2/README.md

Files changed (1) hide show
  1. README.md +26 -0
README.md ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # BERT-Small CORD-19 fine-tuned on SQuAD 2.0
2
+
3
+ [bert-small-cord19 model](https://huggingface.co/NeuML/bert-small-cord19) fine-tuned on SQuAD 2.0
4
+
5
+ ## Building the model
6
+
7
+ ```bash
8
+ python run_squad.py
9
+ --model_type bert
10
+ --model_name_or_path bert-small-cord19
11
+ --do_train
12
+ --do_eval
13
+ --do_lower_case
14
+ --version_2_with_negative
15
+ --train_file train-v2.0.json
16
+ --predict_file dev-v2.0.json
17
+ --per_gpu_train_batch_size 8
18
+ --learning_rate 3e-5
19
+ --num_train_epochs 3.0
20
+ --max_seq_length 384
21
+ --doc_stride 128
22
+ --output_dir bert-small-cord19-squad2
23
+ --save_steps 0
24
+ --threads 8
25
+ --overwrite_cache
26
+ --overwrite_output_dir