|
--- |
|
license: mit |
|
pipeline_tag: text-classification |
|
tags: |
|
- deberta |
|
datasets: |
|
- KnutJaegersberg/FEVER_claim_extraction |
|
--- |
|
|
|
deberta-v3-large trained for one epoch (apparently undertrained, also picked not the smallest batch size) on a dataset that combined FEVER data with externally sourced non-claims. |
|
Label 0: no claim |
|
Label 1: claim |
|
|
|
Paper of the data: |
|
"Claim extraction from text using transfer learning" - By Acharya Ashish Prabhakar, Salar Mohtaj, Sebastian Möller |
|
|
|
https://aclanthology.org/2020.icon-main.39/ |
|
|
|
Performance on held out data: |
|
|
|
Accuracy 0.8128525 |
|
F1_Score 0.854962 |
|
mcc 0.6173648 |
|
|
|
properly is of use already |