Update README.md
Browse files
README.md
CHANGED
@@ -33,21 +33,20 @@ This model is a fine-tuned version of [mrm8488/biomedtra-small-es](https://huggi
|
|
33 |
|
34 |
## Hyperparameters
|
35 |
|
36 |
-
The hyperparameters were chosen based on those used in [
|
37 |
|
38 |
```
|
39 |
-
|
40 |
-
|
41 |
-
|
42 |
-
|
|
|
43 |
```
|
44 |
|
45 |
## Performance
|
46 |
|
47 |
Evaluated on the [hackathon-pln-es/biomed_squad_es_v2](https://huggingface.co/datasets/hackathon-pln-es/biomed_squad_es_v2) dev set.
|
48 |
|
49 |
-
The model was trained for 5 epochs, choosing the epoch with the best f1 score.
|
50 |
-
|
51 |
|Model |Base Model Domain|exact |f1 |HasAns_exact|HasAns_f1|NoAns_exact|NoAns_f1|
|
52 |
|--------------------------------------------------------------|-----------------|-------|-------|------------|---------|-----------|--------|
|
53 |
|hackathon-pln-es/roberta-base-bne-squad2-es |General |67.6341|75.6988|53.7367 |70.0526 |81.2174 |81.2174 |
|
|
|
33 |
|
34 |
## Hyperparameters
|
35 |
|
36 |
+
The hyperparameters were chosen based on those used in [deepset/electra-base-squad2](https://huggingface.co/deepset/electra-base-squad2), an english-based model trained for similar purposes
|
37 |
|
38 |
```
|
39 |
+
--num_train_epochs 10 \
|
40 |
+
--learning_rate 1e-4 \
|
41 |
+
--max_seq_length 384 \
|
42 |
+
--doc_stride 128 \
|
43 |
+
|
44 |
```
|
45 |
|
46 |
## Performance
|
47 |
|
48 |
Evaluated on the [hackathon-pln-es/biomed_squad_es_v2](https://huggingface.co/datasets/hackathon-pln-es/biomed_squad_es_v2) dev set.
|
49 |
|
|
|
|
|
50 |
|Model |Base Model Domain|exact |f1 |HasAns_exact|HasAns_f1|NoAns_exact|NoAns_f1|
|
51 |
|--------------------------------------------------------------|-----------------|-------|-------|------------|---------|-----------|--------|
|
52 |
|hackathon-pln-es/roberta-base-bne-squad2-es |General |67.6341|75.6988|53.7367 |70.0526 |81.2174 |81.2174 |
|