Edit model card

mdeberta-v3-base-ehealth_kd

This model is a finetuned version of mdeberta-v3-base for the eHealth-KD dataset used in a benchmark in the paper TODO. The model has a F1 of 0.844

Please refer to the original publication for more information TODO LINK

Parameters used

parameter Value
batch size 32
learning rate 3e-05
classifier dropout 0.2
warmup ratio 0
warmup steps 0
weight decay 0
optimizer AdamW
epochs 10
early stopping patience 3

BibTeX entry and citation info

TODO
Downloads last month
4
Safetensors
Model size
279M params
Tensor type
I64
·
F32
·
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train IIC/mdeberta-v3-base-ehealth_kd

Collection including IIC/mdeberta-v3-base-ehealth_kd

Evaluation results