Hugging Face's logo

sultan
/
BioM-ELECTRA-Large-SQuAD2-BioASQ8B

Question Answering Transformers PyTorch electra Inference Endpoints
Model card Files Community
1
sultan commited on
Commit
1dfc7f8
•
1 Parent(s): 29d145d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -43,7 +43,7 @@ models.
43
  Training script
44
 
45
  ```python
46
- python3 run_squad.py --model_type electra --model_name_or_path sultan/BioM-ELECTRA-Base-SQuAD2 \
47
  --train_file BioASQ8B/train.json \
48
  --predict_file BioASQ8B/dev.json \
49
  --do_lower_case \
@@ -52,7 +52,7 @@ python3 run_squad.py --model_type electra --model_name_or_path sultan/BioM-ELECT
52
  --threads 20 \
53
  --version_2_with_negative \
54
  --num_train_epochs 3 \
55
- --learning_rate 3e-5 \
56
  --max_seq_length 512 \
57
  --doc_stride 128 \
58
  --per_gpu_train_batch_size 8 \
@@ -63,7 +63,7 @@ python3 run_squad.py --model_type electra --model_name_or_path sultan/BioM-ELECT
63
  --fp16 \
64
  --fp16_opt_level O1 \
65
  --overwrite_output_dir \
66
- --output_dir BioM-ELECTRA-Base-SQuAD-BioASQ \
67
  --overwrite_cache
68
  ```
69
 
43
  Training script
44
 
45
  ```python
46
+ python3 run_squad.py --model_type electra --model_name_or_path sultan/BioM-ELECTRA-Large-SQuAD2 \
47
  --train_file BioASQ8B/train.json \
48
  --predict_file BioASQ8B/dev.json \
49
  --do_lower_case \
52
  --threads 20 \
53
  --version_2_with_negative \
54
  --num_train_epochs 3 \
55
+ --learning_rate 5e-5 \
56
  --max_seq_length 512 \
57
  --doc_stride 128 \
58
  --per_gpu_train_batch_size 8 \
63
  --fp16 \
64
  --fp16_opt_level O1 \
65
  --overwrite_output_dir \
66
+ --output_dir BioM-ELECTRA-Large-SQuAD-BioASQ \
67
  --overwrite_cache
68
  ```
69