👨🏻⚕️ Spanish Clinical Encoders Analysis
Collection
Models and datasets used in the paper `A comparative analysis of Spanish Clinical encoder-based models on NER and classification tasks`
•
92 items
•
Updated
xlm-roberta-large-ctebmsp
This model is a finetuned version of xlm-roberta-large for the CT-EBM-SP (Clinical Trials for Evidence-based Medicine in Spanish) dataset used in a benchmark in the paper TODO. The model has a F1 of 0.906
Please refer to the original publication for more information TODO LINK
Parameters used
| parameter | Value |
|---|---|
| batch size | 64 |
| learning rate | 2e-05 |
| classifier dropout | 0.1 |
| warmup ratio | 0 |
| warmup steps | 0 |
| weight decay | 0 |
| optimizer | AdamW |
| epochs | 10 |
| early stopping patience | 3 |
BibTeX entry and citation info
TODO
- Downloads last month
- 8
Dataset used to train IIC/xlm-roberta-large-ctebmsp
Collection including IIC/xlm-roberta-large-ctebmsp
Evaluation results
- f1 on CT-EBM-SP (Clinical Trials for Evidence-based Medicine in Spanish)test set self-reported0.906