|
--- |
|
license: apache-2.0 |
|
language: |
|
- tr |
|
metrics: |
|
- accuracy |
|
- recall |
|
- f1 |
|
tags: |
|
- deprem-clf-v1 |
|
library_name: transformers |
|
pipeline_tag: text-classification |
|
model-index: |
|
- name: deprem_v12 |
|
results: |
|
- task: |
|
type: text-classification |
|
dataset: |
|
type: deprem_private_dataset_v1_2 |
|
name: deprem_private_dataset_v1_2 |
|
metrics: |
|
- type: recall |
|
value: 0.82 |
|
verified: false |
|
- type: f1 |
|
value: 0.76 |
|
verified: false |
|
widget: |
|
- text: >- |
|
acil acil acil antakyadan istanbula gitmek için antakya expoya ulaşmaya çalışan 19 kişilik bir aile için şehir içi ulaşım desteği istiyoruz. dışardalar üşüyorlar.iletebileceğiniz numaraları bekliyorum |
|
example_title: Örnek |
|
--- |
|
|
|
|
|
|
|
## Eval Results |
|
``` |
|
precision recall f1-score support |
|
|
|
Alakasiz 0.87 0.91 0.89 734 |
|
Barinma 0.79 0.89 0.84 207 |
|
Elektronik 0.69 0.83 0.75 130 |
|
Giysi 0.71 0.81 0.76 94 |
|
Kurtarma 0.82 0.85 0.83 362 |
|
Lojistik 0.57 0.67 0.62 112 |
|
Saglik 0.68 0.85 0.75 108 |
|
Su 0.56 0.76 0.64 78 |
|
Yagma 0.60 0.77 0.68 31 |
|
Yemek 0.71 0.89 0.79 117 |
|
|
|
micro avg 0.77 0.86 0.81 1973 |
|
macro avg 0.70 0.82 0.76 1973 |
|
weighted avg 0.78 0.86 0.82 1973 |
|
samples avg 0.83 0.88 0.84 1973 |
|
|
|
|
|
``` |
|
|
|
## Training Params: |
|
```python |
|
{'per_device_train_batch_size': 32, |
|
'per_device_eval_batch_size': 32, |
|
'learning_rate': 5.8679699888213376e-05, |
|
'weight_decay': 0.03530961718117487, |
|
'num_train_epochs': 4, |
|
'lr_scheduler_type': 'cosine', |
|
'warmup_steps': 40, |
|
'seed': 42, |
|
'fp16': True, |
|
'load_best_model_at_end': True, |
|
'metric_for_best_model': 'macro f1', |
|
'greater_is_better': True |
|
} |
|
``` |
|
|
|
## Threshold: |
|
- **Best Threshold:** 0.40 |
|
|
|
## Class Loss Weights |
|
- Same as Anıl's approach: |
|
```python |
|
[1.0, |
|
1.5167249178108022, |
|
1.7547338578655642, |
|
1.9610520059358458, |
|
1.8684086209021484, |
|
1.8019018017117145, |
|
2.110648663094536, |
|
3.081208739200435, |
|
1.7994815143101963] |
|
|
|
``` |
