cmcmaster commited on
Commit
68e677f
1 Parent(s): 55ad30a

End of training

Browse files
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.2061
19
 
20
  ## Model description
21
 
@@ -41,18 +41,55 @@ The following hyperparameters were used during training:
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
  - lr_scheduler_warmup_ratio: 0.03
44
- - num_epochs: 3
45
 
46
  ### Training results
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
- | 1.1892 | 0.46 | 50 | 0.4762 |
51
- | 0.5424 | 0.93 | 100 | 0.3048 |
52
- | 0.4029 | 1.39 | 150 | 0.2465 |
53
- | 0.3543 | 1.85 | 200 | 0.2272 |
54
- | 0.3315 | 2.31 | 250 | 0.2095 |
55
- | 0.3024 | 2.78 | 300 | 0.2061 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
56
 
57
 
58
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.1133
19
 
20
  ## Model description
21
 
 
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
  - lr_scheduler_warmup_ratio: 0.03
44
+ - num_epochs: 20
45
 
46
  ### Training results
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
+ | 1.6316 | 0.46 | 50 | 0.6287 |
51
+ | 0.6403 | 0.93 | 100 | 0.3378 |
52
+ | 0.4213 | 1.39 | 150 | 0.2460 |
53
+ | 0.3452 | 1.85 | 200 | 0.2184 |
54
+ | 0.306 | 2.31 | 250 | 0.1903 |
55
+ | 0.2634 | 2.78 | 300 | 0.1807 |
56
+ | 0.2423 | 3.24 | 350 | 0.1630 |
57
+ | 0.2224 | 3.7 | 400 | 0.1599 |
58
+ | 0.2107 | 4.17 | 450 | 0.1522 |
59
+ | 0.1922 | 4.63 | 500 | 0.1515 |
60
+ | 0.1887 | 5.09 | 550 | 0.1394 |
61
+ | 0.1821 | 5.56 | 600 | 0.1414 |
62
+ | 0.1705 | 6.02 | 650 | 0.1378 |
63
+ | 0.1602 | 6.48 | 700 | 0.1330 |
64
+ | 0.1579 | 6.94 | 750 | 0.1300 |
65
+ | 0.1497 | 7.41 | 800 | 0.1282 |
66
+ | 0.1534 | 7.87 | 850 | 0.1277 |
67
+ | 0.147 | 8.33 | 900 | 0.1274 |
68
+ | 0.1395 | 8.8 | 950 | 0.1204 |
69
+ | 0.1361 | 9.26 | 1000 | 0.1235 |
70
+ | 0.1353 | 9.72 | 1050 | 0.1210 |
71
+ | 0.1303 | 10.19 | 1100 | 0.1220 |
72
+ | 0.132 | 10.65 | 1150 | 0.1232 |
73
+ | 0.1262 | 11.11 | 1200 | 0.1193 |
74
+ | 0.1228 | 11.57 | 1250 | 0.1229 |
75
+ | 0.1261 | 12.04 | 1300 | 0.1215 |
76
+ | 0.1204 | 12.5 | 1350 | 0.1163 |
77
+ | 0.12 | 12.96 | 1400 | 0.1189 |
78
+ | 0.11 | 13.43 | 1450 | 0.1173 |
79
+ | 0.1183 | 13.89 | 1500 | 0.1149 |
80
+ | 0.108 | 14.35 | 1550 | 0.1178 |
81
+ | 0.1122 | 14.81 | 1600 | 0.1150 |
82
+ | 0.1126 | 15.28 | 1650 | 0.1157 |
83
+ | 0.112 | 15.74 | 1700 | 0.1152 |
84
+ | 0.1046 | 16.2 | 1750 | 0.1156 |
85
+ | 0.1057 | 16.67 | 1800 | 0.1138 |
86
+ | 0.1067 | 17.13 | 1850 | 0.1129 |
87
+ | 0.1078 | 17.59 | 1900 | 0.1140 |
88
+ | 0.1043 | 18.06 | 1950 | 0.1135 |
89
+ | 0.1033 | 18.52 | 2000 | 0.1138 |
90
+ | 0.1017 | 18.98 | 2050 | 0.1140 |
91
+ | 0.102 | 19.44 | 2100 | 0.1125 |
92
+ | 0.1012 | 19.91 | 2150 | 0.1133 |
93
 
94
 
95
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b6002c4d6d11747c2aef18a2544ce1e74f4ec380694dec8944672a937ce0e54b
3
  size 307867048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:277450e6e2c32486280a66c0b9ab63250650b85cca9d9746a145c0ecb4d001a0
3
  size 307867048
runs/Nov10_15-18-25_christopher-System-Product-Name/events.out.tfevents.1699589905.christopher-System-Product-Name.1986702.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3906b2d83c9775631f0cf96d82defb84aeab41341b0ccecfed3fe2376446dd6d
3
+ size 9923
runs/Nov10_15-24-06_christopher-System-Product-Name/events.out.tfevents.1699590247.christopher-System-Product-Name.1992026.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b597882496e954e1b73d74ba4fdf1ccedbbe13dbecbd44c39eddedebd73922ca
3
+ size 14632
runs/Nov10_15-37-19_christopher-System-Product-Name/events.out.tfevents.1699591039.christopher-System-Product-Name.2003950.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c0bbb22fdc3ec70ca7398b80c495b97d908a0671fa9d6b2398d46d100f2de41
3
+ size 24048
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8d0a4ae8ec7c9c8b2555b2f61a8859c64b3d94081ddb22aa1aa7edd2c190f0f4
3
  size 4792
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8cce8e4d2c3994de90beaf7187c95c1c845d1b3b40d1f2bf070c0183d2da8ae7
3
  size 4792