lBober/my-model-MiniLM-Area
Browse files
README.md
CHANGED
@@ -20,11 +20,11 @@ should probably proofread and complete it, then remove this comment. -->
|
|
20 |
|
21 |
This model is a fine-tuned version of [Microsoft/Multilingual-MiniLM-L12-H384](https://huggingface.co/Microsoft/Multilingual-MiniLM-L12-H384) on the None dataset.
|
22 |
It achieves the following results on the evaluation set:
|
23 |
-
- Loss: 1.
|
24 |
-
- Accuracy: 0.
|
25 |
-
- F1: 0.
|
26 |
-
- Precision: 0.
|
27 |
-
- Recall: 0.
|
28 |
|
29 |
## Model description
|
30 |
|
@@ -44,22 +44,37 @@ More information needed
|
|
44 |
|
45 |
The following hyperparameters were used during training:
|
46 |
- learning_rate: 5e-05
|
47 |
-
- train_batch_size:
|
48 |
-
- eval_batch_size:
|
49 |
- seed: 42
|
50 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
51 |
- lr_scheduler_type: linear
|
52 |
-
- num_epochs:
|
53 |
|
54 |
### Training results
|
55 |
|
56 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
|
57 |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
|
58 |
-
| 1.
|
59 |
-
| 1.
|
60 |
-
| 1.
|
61 |
-
| 1.
|
62 |
-
| 1.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
63 |
|
64 |
|
65 |
### Framework versions
|
|
|
20 |
|
21 |
This model is a fine-tuned version of [Microsoft/Multilingual-MiniLM-L12-H384](https://huggingface.co/Microsoft/Multilingual-MiniLM-L12-H384) on the None dataset.
|
22 |
It achieves the following results on the evaluation set:
|
23 |
+
- Loss: 1.4129
|
24 |
+
- Accuracy: 0.5036
|
25 |
+
- F1: 0.4909
|
26 |
+
- Precision: 0.5021
|
27 |
+
- Recall: 0.5036
|
28 |
|
29 |
## Model description
|
30 |
|
|
|
44 |
|
45 |
The following hyperparameters were used during training:
|
46 |
- learning_rate: 5e-05
|
47 |
+
- train_batch_size: 30
|
48 |
+
- eval_batch_size: 5
|
49 |
- seed: 42
|
50 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
51 |
- lr_scheduler_type: linear
|
52 |
+
- num_epochs: 20
|
53 |
|
54 |
### Training results
|
55 |
|
56 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
|
57 |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
|
58 |
+
| 1.8823 | 1.0 | 22 | 1.7754 | 0.3165 | 0.1522 | 0.1002 | 0.3165 |
|
59 |
+
| 1.7966 | 2.0 | 44 | 1.6984 | 0.4029 | 0.2987 | 0.2682 | 0.4029 |
|
60 |
+
| 1.7182 | 3.0 | 66 | 1.6278 | 0.4460 | 0.3334 | 0.2662 | 0.4460 |
|
61 |
+
| 1.6204 | 4.0 | 88 | 1.6025 | 0.4388 | 0.3266 | 0.2619 | 0.4388 |
|
62 |
+
| 1.5906 | 5.0 | 110 | 1.5386 | 0.4892 | 0.3664 | 0.3004 | 0.4892 |
|
63 |
+
| 1.5192 | 6.0 | 132 | 1.5516 | 0.4317 | 0.3209 | 0.2596 | 0.4317 |
|
64 |
+
| 1.4358 | 7.0 | 154 | 1.5271 | 0.4676 | 0.3495 | 0.2795 | 0.4676 |
|
65 |
+
| 1.3818 | 8.0 | 176 | 1.4780 | 0.4748 | 0.3797 | 0.3403 | 0.4748 |
|
66 |
+
| 1.314 | 9.0 | 198 | 1.4462 | 0.5180 | 0.4476 | 0.3974 | 0.5180 |
|
67 |
+
| 1.2579 | 10.0 | 220 | 1.4591 | 0.5036 | 0.4265 | 0.3722 | 0.5036 |
|
68 |
+
| 1.2336 | 11.0 | 242 | 1.4948 | 0.5108 | 0.4529 | 0.4399 | 0.5108 |
|
69 |
+
| 1.1771 | 12.0 | 264 | 1.4809 | 0.5108 | 0.4500 | 0.4315 | 0.5108 |
|
70 |
+
| 1.1311 | 13.0 | 286 | 1.4216 | 0.5540 | 0.5039 | 0.6025 | 0.5540 |
|
71 |
+
| 1.0755 | 14.0 | 308 | 1.4449 | 0.5108 | 0.4819 | 0.5087 | 0.5108 |
|
72 |
+
| 1.0362 | 15.0 | 330 | 1.4401 | 0.5324 | 0.5149 | 0.5126 | 0.5324 |
|
73 |
+
| 1.0026 | 16.0 | 352 | 1.3924 | 0.5396 | 0.5192 | 0.5101 | 0.5396 |
|
74 |
+
| 0.9734 | 17.0 | 374 | 1.4036 | 0.5180 | 0.5024 | 0.5116 | 0.5180 |
|
75 |
+
| 0.949 | 18.0 | 396 | 1.3800 | 0.5252 | 0.5108 | 0.5189 | 0.5252 |
|
76 |
+
| 0.9293 | 19.0 | 418 | 1.4091 | 0.5036 | 0.4895 | 0.4982 | 0.5036 |
|
77 |
+
| 0.9185 | 20.0 | 440 | 1.4129 | 0.5036 | 0.4909 | 0.5021 | 0.5036 |
|
78 |
|
79 |
|
80 |
### Framework versions
|
model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 470649364
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f3e79ef1b12ff1eeaf812d6b071d4c4b1f132b471b748ecfc0003e5be4c5f4e0
|
3 |
size 470649364
|
runs/May25_20-57-55_54438e66731d/events.out.tfevents.1716670676.54438e66731d.31159.0
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9f7badbc8d7da0133c2d631ed358d367f5c4673995a261e3a56142ea1e539457
|
3 |
+
size 9189
|
runs/May25_21-02-04_54438e66731d/events.out.tfevents.1716670924.54438e66731d.32433.0
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c657d3c74b77ea5569f04d0dc56f1c5dbe0b5da0d08a9b75155b10591fbe6e30
|
3 |
+
size 19054
|
training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5112
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4b04b35332e6e272ccc95c9838e013faaf73ea77571f263bb4aa2c90d821381a
|
3 |
size 5112
|