File size: 1,941 Bytes
2d61a68 fbff7f3 2d61a68 fbff7f3 2c5fb89 fbff7f3 2c5fb89 fbff7f3 c720f49 6911357 c720f49 6911357 c720f49 fbff7f3 3121a1d fbff7f3 3121a1d fbff7f3 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 |
---
license: cc-by-nc-4.0
language:
- hu
metrics:
- accuracy
model-index:
- name: huBERTPlain
results:
- task:
type: text-classification
metrics:
- type: accuracy
value: 0.73
---
## Model description
Cased fine-tuned BERT model for Hungarian, trained on a dataset provided by National Tax and Customs Administration - Hungary (NAV): Public Accessibilty Programme.
## Intended uses & limitations
The model can be used as any other (cased) BERT model. It has been tested recognizing "accessible" and "original" sentences, where:
* "accessible" - "Label_0": sentence, that can be considered as comprehensible (regarding to Plain Language directives)
* "original" - "Label_1": sentence, that needs to rephrased in order to follow Plain Language Guidelines.
## Training
Fine-tuned version of the original huBERT model (`SZTAKI-HLT/hubert-base-cc`), trained on information materials provided by NAV linguistic experts.
## Eval results
| Class | Precision | Recall | F-Score |
|-----|------------|------------|------|
| **Accessible / Label_0** | **0.71** | **0.79** | **0.75**|
| **Original / Label_1** | **0.76** | **0.67** | **0.71**|
| **accuracy** | | | **0.73**|
| **macro avg** | **0.74** | **0.73** | **0.73**|
| **weighted avg** | **0.74** | **0.73** | **0.73**|
## Usage
```py
from transformers import AutoTokenizer, AutoModelForSequenceClassification
tokenizer = AutoTokenizer.from_pretrained("uvegesistvan/huBERTPlain")
model = AutoModelForSequenceClassification.from_pretrained("uvegesistvan/huBERTPlain")
```
### BibTeX entry and citation info
If you use the model, please cite the following dissertation (to be submitted for workshop discussion):
Bibtex:
```bibtex
@PhDThesis{ Uveges:2024,
author = {{"U}veges, Istv{\'a}n},
title = {A k{\"o}z{\'e}rthet{\"o}s{\'e}g lehet{\"o}s{\'e}gei a jogi dom{\'e}n sz{\"o}vegeiben},
year = {2023},
school = {Szegedi Tudom\'anyegyetem}
}
``` |