Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,53 @@
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
---
|
4 |
+
## Deprem Niyet Sınıflandırma (Dataset v1.3, BERT 128k)
|
5 |
+
Alakasız sınıfı atılarak eğitildi.
|
6 |
+
## Eval Results
|
7 |
+
```
|
8 |
+
precision recall f1-score support
|
9 |
+
|
10 |
+
Lojistik 0.83 0.86 0.84 22
|
11 |
+
Elektrik Kaynagi 0.71 0.95 0.81 39
|
12 |
+
Arama Ekipmani 0.72 0.80 0.76 82
|
13 |
+
Cenaze 0.50 0.33 0.40 3
|
14 |
+
Giysi 0.79 0.96 0.87 91
|
15 |
+
Enkaz Kaldirma 0.99 0.95 0.97 601
|
16 |
+
Isinma 0.75 0.90 0.82 112
|
17 |
+
Barınma 0.98 0.95 0.96 292
|
18 |
+
Tuvalet 0.83 1.00 0.91 5
|
19 |
+
Su 0.80 0.85 0.83 39
|
20 |
+
Yemek 0.94 0.95 0.94 138
|
21 |
+
Saglik 0.80 0.85 0.83 75
|
22 |
+
|
23 |
+
micro avg 0.90 0.93 0.92 1499
|
24 |
+
macro avg 0.80 0.86 0.83 1499
|
25 |
+
weighted avg 0.91 0.93 0.92 1499
|
26 |
+
samples avg 0.94 0.95 0.94 1499
|
27 |
+
|
28 |
+
```
|
29 |
+
Reproducibility icin trainer arg'lari:
|
30 |
+
```python
|
31 |
+
TrainingArguments(
|
32 |
+
fp16=True,
|
33 |
+
evaluation_strategy = "steps",
|
34 |
+
save_strategy = "steps",
|
35 |
+
learning_rate=5.1058553791201954e-05,
|
36 |
+
per_device_train_batch_size=batch_size,
|
37 |
+
per_device_eval_batch_size=batch_size*2,
|
38 |
+
num_train_epochs=4,
|
39 |
+
load_best_model_at_end=True,
|
40 |
+
metric_for_best_model="macro f1",
|
41 |
+
logging_steps = step_size,
|
42 |
+
seed = 42,
|
43 |
+
data_seed = 42,
|
44 |
+
dataloader_num_workers = 0,
|
45 |
+
lr_scheduler_type ="linear",
|
46 |
+
warmup_steps=0,
|
47 |
+
weight_decay=0.06437697487126866,
|
48 |
+
full_determinism = True,
|
49 |
+
group_by_length = True
|
50 |
+
)
|
51 |
+
```
|
52 |
+
Threshold:
|
53 |
+
Best Threshold: 0.52
|