smaximo commited on
Commit
4596d8d
1 Parent(s): 1681021

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -7
README.md CHANGED
@@ -33,21 +33,20 @@ This model is a fine-tuned version of [mrm8488/biomedtra-small-es](https://huggi
33
 
34
  ## Hyperparameters
35
 
36
- The hyperparameters were chosen based on those used in [sultan/BioM-ELECTRA-Large-SQuAD2](https://huggingface.co/sultan/BioM-ELECTRA-Large-SQuAD2), an english-based model trained for similar purposes
37
 
38
  ```
39
- --num_train_epochs 5
40
- --learning_rate 5e-5
41
- --max_seq_length 512
42
- --doc_stride 128
 
43
  ```
44
 
45
  ## Performance
46
 
47
  Evaluated on the [hackathon-pln-es/biomed_squad_es_v2](https://huggingface.co/datasets/hackathon-pln-es/biomed_squad_es_v2) dev set.
48
 
49
- The model was trained for 5 epochs, choosing the epoch with the best f1 score.
50
-
51
  |Model |Base Model Domain|exact |f1 |HasAns_exact|HasAns_f1|NoAns_exact|NoAns_f1|
52
  |--------------------------------------------------------------|-----------------|-------|-------|------------|---------|-----------|--------|
53
  |hackathon-pln-es/roberta-base-bne-squad2-es |General |67.6341|75.6988|53.7367 |70.0526 |81.2174 |81.2174 |
 
33
 
34
  ## Hyperparameters
35
 
36
+ The hyperparameters were chosen based on those used in [deepset/electra-base-squad2](https://huggingface.co/deepset/electra-base-squad2), an english-based model trained for similar purposes
37
 
38
  ```
39
+ --num_train_epochs 10 \
40
+ --learning_rate 1e-4 \
41
+ --max_seq_length 384 \
42
+ --doc_stride 128 \
43
+
44
  ```
45
 
46
  ## Performance
47
 
48
  Evaluated on the [hackathon-pln-es/biomed_squad_es_v2](https://huggingface.co/datasets/hackathon-pln-es/biomed_squad_es_v2) dev set.
49
 
 
 
50
  |Model |Base Model Domain|exact |f1 |HasAns_exact|HasAns_f1|NoAns_exact|NoAns_f1|
51
  |--------------------------------------------------------------|-----------------|-------|-------|------------|---------|-----------|--------|
52
  |hackathon-pln-es/roberta-base-bne-squad2-es |General |67.6341|75.6988|53.7367 |70.0526 |81.2174 |81.2174 |