lBober commited on
Commit
991a300
1 Parent(s): b73f8fe

lBober/my-model-MiniLM-Area

Browse files
README.md CHANGED
@@ -20,11 +20,11 @@ should probably proofread and complete it, then remove this comment. -->
20
 
21
  This model is a fine-tuned version of [Microsoft/Multilingual-MiniLM-L12-H384](https://huggingface.co/Microsoft/Multilingual-MiniLM-L12-H384) on the None dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 1.5091
24
- - Accuracy: 0.4101
25
- - F1: 0.3008
26
- - Precision: 0.2560
27
- - Recall: 0.4101
28
 
29
  ## Model description
30
 
@@ -44,22 +44,37 @@ More information needed
44
 
45
  The following hyperparameters were used during training:
46
  - learning_rate: 5e-05
47
- - train_batch_size: 8
48
- - eval_batch_size: 8
49
  - seed: 42
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
- - num_epochs: 5
53
 
54
  ### Training results
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
57
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
58
- | 1.8054 | 1.0 | 81 | 1.7186 | 0.3741 | 0.2567 | 0.2028 | 0.3741 |
59
- | 1.658 | 2.0 | 162 | 1.6347 | 0.3669 | 0.2477 | 0.1994 | 0.3669 |
60
- | 1.5442 | 3.0 | 243 | 1.5759 | 0.3957 | 0.2674 | 0.2039 | 0.3957 |
61
- | 1.465 | 4.0 | 324 | 1.5283 | 0.4388 | 0.3402 | 0.3001 | 0.4388 |
62
- | 1.3915 | 5.0 | 405 | 1.5091 | 0.4101 | 0.3008 | 0.2560 | 0.4101 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
63
 
64
 
65
  ### Framework versions
 
20
 
21
  This model is a fine-tuned version of [Microsoft/Multilingual-MiniLM-L12-H384](https://huggingface.co/Microsoft/Multilingual-MiniLM-L12-H384) on the None dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 1.4129
24
+ - Accuracy: 0.5036
25
+ - F1: 0.4909
26
+ - Precision: 0.5021
27
+ - Recall: 0.5036
28
 
29
  ## Model description
30
 
 
44
 
45
  The following hyperparameters were used during training:
46
  - learning_rate: 5e-05
47
+ - train_batch_size: 30
48
+ - eval_batch_size: 5
49
  - seed: 42
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
+ - num_epochs: 20
53
 
54
  ### Training results
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
57
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
58
+ | 1.8823 | 1.0 | 22 | 1.7754 | 0.3165 | 0.1522 | 0.1002 | 0.3165 |
59
+ | 1.7966 | 2.0 | 44 | 1.6984 | 0.4029 | 0.2987 | 0.2682 | 0.4029 |
60
+ | 1.7182 | 3.0 | 66 | 1.6278 | 0.4460 | 0.3334 | 0.2662 | 0.4460 |
61
+ | 1.6204 | 4.0 | 88 | 1.6025 | 0.4388 | 0.3266 | 0.2619 | 0.4388 |
62
+ | 1.5906 | 5.0 | 110 | 1.5386 | 0.4892 | 0.3664 | 0.3004 | 0.4892 |
63
+ | 1.5192 | 6.0 | 132 | 1.5516 | 0.4317 | 0.3209 | 0.2596 | 0.4317 |
64
+ | 1.4358 | 7.0 | 154 | 1.5271 | 0.4676 | 0.3495 | 0.2795 | 0.4676 |
65
+ | 1.3818 | 8.0 | 176 | 1.4780 | 0.4748 | 0.3797 | 0.3403 | 0.4748 |
66
+ | 1.314 | 9.0 | 198 | 1.4462 | 0.5180 | 0.4476 | 0.3974 | 0.5180 |
67
+ | 1.2579 | 10.0 | 220 | 1.4591 | 0.5036 | 0.4265 | 0.3722 | 0.5036 |
68
+ | 1.2336 | 11.0 | 242 | 1.4948 | 0.5108 | 0.4529 | 0.4399 | 0.5108 |
69
+ | 1.1771 | 12.0 | 264 | 1.4809 | 0.5108 | 0.4500 | 0.4315 | 0.5108 |
70
+ | 1.1311 | 13.0 | 286 | 1.4216 | 0.5540 | 0.5039 | 0.6025 | 0.5540 |
71
+ | 1.0755 | 14.0 | 308 | 1.4449 | 0.5108 | 0.4819 | 0.5087 | 0.5108 |
72
+ | 1.0362 | 15.0 | 330 | 1.4401 | 0.5324 | 0.5149 | 0.5126 | 0.5324 |
73
+ | 1.0026 | 16.0 | 352 | 1.3924 | 0.5396 | 0.5192 | 0.5101 | 0.5396 |
74
+ | 0.9734 | 17.0 | 374 | 1.4036 | 0.5180 | 0.5024 | 0.5116 | 0.5180 |
75
+ | 0.949 | 18.0 | 396 | 1.3800 | 0.5252 | 0.5108 | 0.5189 | 0.5252 |
76
+ | 0.9293 | 19.0 | 418 | 1.4091 | 0.5036 | 0.4895 | 0.4982 | 0.5036 |
77
+ | 0.9185 | 20.0 | 440 | 1.4129 | 0.5036 | 0.4909 | 0.5021 | 0.5036 |
78
 
79
 
80
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bd329f43ea95cbc64ce7701a2061230a001cd0d6319f32865ee4064de8becb86
3
  size 470649364
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f3e79ef1b12ff1eeaf812d6b071d4c4b1f132b471b748ecfc0003e5be4c5f4e0
3
  size 470649364
runs/May25_20-57-55_54438e66731d/events.out.tfevents.1716670676.54438e66731d.31159.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f7badbc8d7da0133c2d631ed358d367f5c4673995a261e3a56142ea1e539457
3
+ size 9189
runs/May25_21-02-04_54438e66731d/events.out.tfevents.1716670924.54438e66731d.32433.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c657d3c74b77ea5569f04d0dc56f1c5dbe0b5da0d08a9b75155b10591fbe6e30
3
+ size 19054
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f36e37243728c4447c24fcd97bff1ebcd61072c259ef19542ecda0ae2176afca
3
  size 5112
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b04b35332e6e272ccc95c9838e013faaf73ea77571f263bb4aa2c90d821381a
3
  size 5112