Create README.md

README.md

@@ -0,0 +1,46 @@
+---
+language: es
+datasets:
+- squad_es
+- hackathon-pln-es/biomed_squad_es_v2
+metrics:
+- "f1"
+
+---
+
+# biomedtra-small for QA 
+This model is a fine-tuned version of [mrm8488/biomedtra-small-es](https://huggingface.co/mrm8488/biomedtra-small-es) on the [squad_es (v2)](https://huggingface.co/datasets/squad_es) training dataset.
+
+
+## Hyperparameters
+
+The hyperparameters were chosen based on those used in [sultan/BioM-ELECTRA-Large-SQuAD2](https://huggingface.co/sultan/BioM-ELECTRA-Large-SQuAD2), an english-based model trained for similar purposes
+
+```
+ --num_train_epochs 5
+ --learning_rate 5e-5
+ --max_seq_length 512
+ --doc_stride 128 
+```
+
+## Performance
+
+Evaluated on the [hackathon-pln-es/biomed_squad_es_v2](link) dev set.
+
+The model was trained for 5 epochs, choosing the epoch with the best f1 score.
+
+```
+  eval_exact             = 29.7274
+  eval_f1                = 36.4098
+
+  eval_HasAns_exact      = 32.0285
+  eval_HasAns_f1         = 45.5479
+  eval_HasAns_total      =     562
+  eval_NoAns_exact       = 27.4783
+  eval_NoAns_f1          = 27.4783
+  eval_NoAns_total       =     575
+
+```
+
+## Team
+Santiago Maximo: [smaximo](https://huggingface.co/smaximo)