Hugging Face's logo

esahit
/
ul2-large-dutch-finetuned-oba-book-search

PEFT
TensorBoard
Safetensors
Generated from Trainer
Model card Files Metrics Community
esahit commited on
Commit
f1b46cd
•
1 Parent(s): eedf7ce

Third full training run on complete dataset

Browse files
Files changed (1) hide show
  1. README.md +62 -33
README.md CHANGED
@@ -16,8 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [yhavinga/ul2-large-dutch](https://huggingface.co/yhavinga/ul2-large-dutch) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 4.4355
20
- - Top-5-accuracy: 0.3172
21
 
22
  ## Model description
23
 
@@ -42,40 +42,69 @@ The following hyperparameters were used during training:
42
  - seed: 42
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
- - num_epochs: 5
46
 
47
  ### Training results
48
 
49
- | Training Loss | Epoch | Step | Validation Loss | Top-5-accuracy |
50
- |:-------------:|:------:|:----:|:---------------:|:--------------:|
51
- | 7.5872 | 0.1729 | 200 | 5.1429 | 0.0 |
52
- | 6.5938 | 0.3457 | 400 | 4.5886 | 0.0680 |
53
- | 6.2525 | 0.5186 | 600 | 4.7437 | 0.0453 |
54
- | 6.1056 | 0.6914 | 800 | 4.6423 | 0.2493 |
55
- | 6.0637 | 0.8643 | 1000 | 4.6631 | 0.1586 |
56
- | 5.9667 | 1.0372 | 1200 | 4.5781 | 0.0227 |
57
- | 5.8045 | 1.2100 | 1400 | 4.4807 | 0.1360 |
58
- | 5.7737 | 1.3829 | 1600 | 4.4840 | 0.0453 |
59
- | 5.7215 | 1.5557 | 1800 | 4.5203 | 0.0680 |
60
- | 5.6041 | 1.7286 | 2000 | 4.4304 | 0.0680 |
61
- | 5.5924 | 1.9015 | 2200 | 4.5078 | 0.0453 |
62
- | 5.5273 | 2.0743 | 2400 | 4.5331 | 0.1133 |
63
- | 5.5034 | 2.2472 | 2600 | 4.4927 | 0.0453 |
64
- | 5.5556 | 2.4201 | 2800 | 4.4918 | 0.0227 |
65
- | 5.5071 | 2.5929 | 3000 | 4.4780 | 0.1133 |
66
- | 5.4722 | 2.7658 | 3200 | 4.4836 | 0.0453 |
67
- | 5.4154 | 2.9386 | 3400 | 4.4614 | 0.0680 |
68
- | 5.4479 | 3.1115 | 3600 | 4.4920 | 0.0680 |
69
- | 5.3862 | 3.2844 | 3800 | 4.5000 | 0.0680 |
70
- | 5.3983 | 3.4572 | 4000 | 4.4335 | 0.1360 |
71
- | 5.3797 | 3.6301 | 4200 | 4.5029 | 0.1586 |
72
- | 5.3729 | 3.8029 | 4400 | 4.4466 | 0.1586 |
73
- | 5.4011 | 3.9758 | 4600 | 4.4359 | 0.1813 |
74
- | 5.3342 | 4.1487 | 4800 | 4.4264 | 0.2039 |
75
- | 5.3995 | 4.3215 | 5000 | 4.4568 | 0.2039 |
76
- | 5.2805 | 4.4944 | 5200 | 4.4460 | 0.2719 |
77
- | 5.3532 | 4.6672 | 5400 | 4.4434 | 0.3172 |
78
- | 5.3444 | 4.8401 | 5600 | 4.4355 | 0.3172 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
79
 
80
 
81
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [yhavinga/ul2-large-dutch](https://huggingface.co/yhavinga/ul2-large-dutch) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 4.2516
20
+ - Top-5-accuracy: 3.5577
21
 
22
  ## Model description
23
 
 
42
  - seed: 42
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
+ - num_epochs: 10
46
 
47
  ### Training results
48
 
49
+ | Training Loss | Epoch | Step | Validation Loss | Top-5-accuracy |
50
+ |:-------------:|:------:|:-----:|:---------------:|:--------------:|
51
+ | 7.6676 | 0.1729 | 200 | 5.1849 | 0.0 |
52
+ | 6.7322 | 0.3457 | 400 | 4.6030 | 0.0680 |
53
+ | 6.3351 | 0.5186 | 600 | 4.5872 | 0.0 |
54
+ | 6.1233 | 0.6914 | 800 | 4.5459 | 0.0453 |
55
+ | 6.0233 | 0.8643 | 1000 | 4.6328 | 0.0453 |
56
+ | 5.9119 | 1.0372 | 1200 | 4.6239 | 0.0 |
57
+ | 5.7683 | 1.2100 | 1400 | 4.5214 | 0.0680 |
58
+ | 5.8039 | 1.3829 | 1600 | 4.4935 | 0.0680 |
59
+ | 5.7866 | 1.5557 | 1800 | 4.4634 | 0.1586 |
60
+ | 5.6501 | 1.7286 | 2000 | 4.5163 | 0.1360 |
61
+ | 5.5949 | 1.9015 | 2200 | 4.4098 | 0.0906 |
62
+ | 5.5334 | 2.0743 | 2400 | 4.4172 | 0.0906 |
63
+ | 5.5175 | 2.2472 | 2600 | 4.4015 | 0.1586 |
64
+ | 5.5198 | 2.4201 | 2800 | 4.4079 | 0.1586 |
65
+ | 5.4601 | 2.5929 | 3000 | 4.4179 | 0.3172 |
66
+ | 5.5095 | 2.7658 | 3200 | 4.4219 | 0.3626 |
67
+ | 5.3924 | 2.9386 | 3400 | 4.3597 | 0.3399 |
68
+ | 5.4045 | 3.1115 | 3600 | 4.3392 | 0.6798 |
69
+ | 5.347 | 3.2844 | 3800 | 4.3186 | 0.5892 |
70
+ | 5.3494 | 3.4572 | 4000 | 4.3192 | 0.6798 |
71
+ | 5.3725 | 3.6301 | 4200 | 4.3734 | 0.3852 |
72
+ | 5.3407 | 3.8029 | 4400 | 4.3198 | 1.2690 |
73
+ | 5.3895 | 3.9758 | 4600 | 4.3233 | 0.7478 |
74
+ | 5.2923 | 4.1487 | 4800 | 4.3004 | 0.7931 |
75
+ | 5.3286 | 4.3215 | 5000 | 4.3195 | 1.2010 |
76
+ | 5.2082 | 4.4944 | 5200 | 4.3138 | 1.6089 |
77
+ | 5.2735 | 4.6672 | 5400 | 4.3083 | 1.9261 |
78
+ | 5.2474 | 4.8401 | 5600 | 4.2709 | 2.1754 |
79
+ | 5.2209 | 5.0130 | 5800 | 4.2812 | 2.2660 |
80
+ | 5.1823 | 5.1858 | 6000 | 4.2709 | 2.7646 |
81
+ | 5.2629 | 5.3587 | 6200 | 4.2837 | 2.2207 |
82
+ | 5.1891 | 5.5315 | 6400 | 4.3217 | 2.3114 |
83
+ | 5.2377 | 5.7044 | 6600 | 4.2810 | 2.6966 |
84
+ | 5.1904 | 5.8773 | 6800 | 4.3004 | 2.4247 |
85
+ | 5.1698 | 6.0501 | 7000 | 4.2687 | 2.6513 |
86
+ | 5.2109 | 6.2230 | 7200 | 4.2725 | 2.9912 |
87
+ | 5.2525 | 6.3959 | 7400 | 4.3036 | 2.8325 |
88
+ | 5.1317 | 6.5687 | 7600 | 4.2520 | 3.3311 |
89
+ | 5.1662 | 6.7416 | 7800 | 4.2796 | 2.6059 |
90
+ | 5.1612 | 6.9144 | 8000 | 4.2556 | 2.9005 |
91
+ | 5.223 | 7.0873 | 8200 | 4.2581 | 3.2857 |
92
+ | 5.1323 | 7.2602 | 8400 | 4.2629 | 3.3084 |
93
+ | 5.1419 | 7.4330 | 8600 | 4.2433 | 3.3764 |
94
+ | 5.1321 | 7.6059 | 8800 | 4.2467 | 3.4670 |
95
+ | 5.083 | 7.7787 | 9000 | 4.2507 | 3.4670 |
96
+ | 5.1572 | 7.9516 | 9200 | 4.2737 | 3.3764 |
97
+ | 5.1645 | 8.1245 | 9400 | 4.2425 | 3.5123 |
98
+ | 5.1241 | 8.2973 | 9600 | 4.2509 | 3.3990 |
99
+ | 5.2118 | 8.4702 | 9800 | 4.2655 | 3.3311 |
100
+ | 5.1387 | 8.6430 | 10000 | 4.2600 | 3.4670 |
101
+ | 5.1755 | 8.8159 | 10200 | 4.2686 | 3.3764 |
102
+ | 5.1629 | 8.9888 | 10400 | 4.2540 | 3.4897 |
103
+ | 5.1535 | 9.1616 | 10600 | 4.2442 | 3.6257 |
104
+ | 5.2023 | 9.3345 | 10800 | 4.2558 | 3.4897 |
105
+ | 5.087 | 9.5073 | 11000 | 4.2468 | 3.5803 |
106
+ | 5.0679 | 9.6802 | 11200 | 4.2485 | 3.5803 |
107
+ | 5.1546 | 9.8531 | 11400 | 4.2516 | 3.5577 |
108
 
109
 
110
  ### Framework versions