metadata
license: apache-2.0
language:
- tr
metrics:
- accuracy
- recall
- f1
tags:
- deprem-clf-v1
library_name: transformers
pipeline_tag: text-classification
model-index:
- name: deprem_v12
results:
- task:
type: text-classification
dataset:
type: deprem_private_dataset_v1_2
name: deprem_private_dataset_v1_2
metrics:
- type: recall
value: 0.82
verified: false
- type: f1
value: 0.76
verified: false
widget:
- text: >-
acil acil acil antakyadan istanbula gitmek için antakya expoya ulaşmaya
çalışan 19 kişilik bir aile için şehir içi ulaşım desteği istiyoruz.
dışardalar üşüyorlar.iletebileceğiniz numaraları bekliyorum
example_title: Örnek
Eval Results
precision recall f1-score support
Alakasiz 0.87 0.91 0.89 734
Barinma 0.79 0.89 0.84 207
Elektronik 0.69 0.83 0.75 130
Giysi 0.71 0.81 0.76 94
Kurtarma 0.82 0.85 0.83 362
Lojistik 0.57 0.67 0.62 112
Saglik 0.68 0.85 0.75 108
Su 0.56 0.76 0.64 78
Yagma 0.60 0.77 0.68 31
Yemek 0.71 0.89 0.79 117
micro avg 0.77 0.86 0.81 1973
macro avg 0.70 0.82 0.76 1973
weighted avg 0.78 0.86 0.82 1973
samples avg 0.83 0.88 0.84 1973
Training Params:
{'per_device_train_batch_size': 32,
'per_device_eval_batch_size': 32,
'learning_rate': 5.8679699888213376e-05,
'weight_decay': 0.03530961718117487,
'num_train_epochs': 4,
'lr_scheduler_type': 'cosine',
'warmup_steps': 40,
'seed': 42,
'fp16': True,
'load_best_model_at_end': True,
'metric_for_best_model': 'macro f1',
'greater_is_better': True
}
Threshold:
- Best Threshold: 0.40
Class Loss Weights
- Same as Anıl's approach:
[1.0,
1.5167249178108022,
1.7547338578655642,
1.9610520059358458,
1.8684086209021484,
1.8019018017117145,
2.110648663094536,
3.081208739200435,
1.7994815143101963]