File size: 11,007 Bytes
e1c6501
179fb68
e1c6501
 
 
 
 
 
 
 
 
 
 
 
179fb68
e1c6501
4e8db7b
 
 
e1c6501
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
b212e00
 
f8cc621
5533e34
 
 
 
 
 
 
 
d2bfc48
bde8d71
 
 
 
3977ba9
 
edb900f
 
1aae0e5
 
 
0bcb968
c25f19e
e235224
 
 
 
ebb6731
947eb52
3399b4a
83da3cb
cc1c996
e028032
586ec85
 
 
 
eaf11ba
d50cd1d
67ea973
 
16c10a4
bc3cb6b
 
 
 
 
 
1e595a8
 
 
ab37111
9cf8cfd
 
 
74da286
a52220c
 
 
 
 
 
4e43b46
 
 
4ef00c3
a351f07
 
16f2599
f5c0bd9
 
 
 
9933f32
 
aba97be
 
 
ce1a807
 
 
 
8dc377b
 
98acd52
00b99c8
bc21505
29a60fd
99d253c
 
 
 
766e4df
 
 
0529e56
 
 
 
e0dead5
 
 
0475f49
93a2ac8
1bde927
37477cf
5869920
72fdb77
 
 
 
f11453b
e75d474
f5bc47a
 
60fbe73
9515f8e
 
 
 
711d6f5
 
9005a73
ff1e8aa
 
 
8427fab
4ddc0cb
74d62db
 
39096c8
9b7a8dd
 
 
259b996
 
39cc8bf
4e38339
736bc12
 
 
 
1fe6cd7
 
 
c834753
 
 
 
3ed8559
 
8d6857d
f909ef8
 
 
ad77d2d
dcbf848
 
 
 
df2a22a
6d8854f
990a39c
3ff9fa8
 
 
 
d340232
b110650
c370e62
 
 
 
 
7c93446
6eb8c00
 
 
 
03a6fef
 
 
7c2716e
 
2290981
dbcbb7f
ffb4610
 
f3f5b14
8a4e7c8
 
 
 
 
 
8acc378
446ceb9
de46ae3
2dd13ac
859a0b2
 
eb9a2b2
 
 
0ad2c0f
 
8364b63
035cebb
f5746fa
92e0dd3
0f11baf
 
 
83961b4
95a9ba5
24ca287
 
94357fd
b3716f5
57a38f9
3ab313b
 
 
 
17b17fb
 
 
 
90781d1
 
 
 
684a507
 
4e8db7b
 
e1c6501
 
 
 
f8cc621
e1c6501
f8cc621
e1c6501
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
---
base_model: Malvegil/prologue_creator-model
tags:
- generated_from_keras_callback
model-index:
- name: Malvegil/prologue_creator-model
  results: []
---

<!-- This model card has been generated automatically according to the information Keras had access to. You should
probably proofread and complete it, then remove this comment. -->

# Malvegil/prologue_creator-model

This model is a fine-tuned version of [Malvegil/prologue_creator-model](https://huggingface.co/Malvegil/prologue_creator-model) on an unknown dataset.
It achieves the following results on the evaluation set:
- Train Loss: 0.8078
- Validation Loss: 5.6164
- Epoch: 235

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}
- training_precision: float32

### Training results

| Train Loss | Validation Loss | Epoch |
|:----------:|:---------------:|:-----:|
| 9.6983     | 8.6325          | 0     |
| 7.5394     | 7.4380          | 1     |
| 6.8454     | 6.9855          | 2     |
| 6.5034     | 6.8347          | 3     |
| 6.3289     | 6.6883          | 4     |
| 6.1540     | 6.5173          | 5     |
| 6.0244     | 6.3997          | 6     |
| 5.9258     | 6.3245          | 7     |
| 5.8095     | 6.2648          | 8     |
| 5.7688     | 6.1865          | 9     |
| 5.6244     | 6.1095          | 10    |
| 5.5619     | 6.0552          | 11    |
| 5.4940     | 6.0000          | 12    |
| 5.3603     | 5.9456          | 13    |
| 5.2852     | 5.8861          | 14    |
| 5.2218     | 5.8256          | 15    |
| 5.1715     | 5.7722          | 16    |
| 5.0556     | 5.7236          | 17    |
| 5.0339     | 5.6669          | 18    |
| 4.8776     | 5.6155          | 19    |
| 4.9133     | 5.5683          | 20    |
| 4.8350     | 5.5166          | 21    |
| 4.6951     | 5.4712          | 22    |
| 4.7144     | 5.4447          | 23    |
| 4.6560     | 5.3954          | 24    |
| 4.6125     | 5.3449          | 25    |
| 4.5494     | 5.3382          | 26    |
| 4.3536     | 5.2989          | 27    |
| 4.3613     | 5.2537          | 28    |
| 4.3123     | 5.2269          | 29    |
| 4.2677     | 5.2115          | 30    |
| 4.2407     | 5.1566          | 31    |
| 4.1543     | 5.1413          | 32    |
| 4.0961     | 5.1284          | 33    |
| 4.0779     | 5.0771          | 34    |
| 4.0303     | 5.0722          | 35    |
| 3.9734     | 5.0550          | 36    |
| 3.9541     | 5.0060          | 37    |
| 3.9188     | 4.9941          | 38    |
| 3.8350     | 4.9851          | 39    |
| 3.8081     | 4.9648          | 40    |
| 3.7395     | 4.9533          | 41    |
| 3.7045     | 4.9112          | 42    |
| 3.6765     | 4.9185          | 43    |
| 3.5667     | 4.8981          | 44    |
| 3.5491     | 4.8510          | 45    |
| 3.5547     | 4.8688          | 46    |
| 3.5317     | 4.8393          | 47    |
| 3.4210     | 4.8366          | 48    |
| 3.4503     | 4.8120          | 49    |
| 3.4187     | 4.8045          | 50    |
| 3.3313     | 4.7899          | 51    |
| 3.2695     | 4.7733          | 52    |
| 3.2980     | 4.7643          | 53    |
| 3.2614     | 4.7592          | 54    |
| 3.2011     | 4.7353          | 55    |
| 3.1756     | 4.7323          | 56    |
| 3.1325     | 4.7405          | 57    |
| 3.1642     | 4.6849          | 58    |
| 3.0915     | 4.7039          | 59    |
| 3.0950     | 4.6905          | 60    |
| 2.9946     | 4.6777          | 61    |
| 3.0338     | 4.7064          | 62    |
| 2.9554     | 4.6617          | 63    |
| 2.9999     | 4.6723          | 64    |
| 2.9410     | 4.6397          | 65    |
| 2.9157     | 4.6493          | 66    |
| 2.8930     | 4.6641          | 67    |
| 2.8620     | 4.6019          | 68    |
| 2.8726     | 4.6564          | 69    |
| 2.8386     | 4.6286          | 70    |
| 2.8574     | 4.6259          | 71    |
| 2.8023     | 4.6359          | 72    |
| 2.7938     | 4.6031          | 73    |
| 2.7686     | 4.6159          | 74    |
| 2.7211     | 4.6128          | 75    |
| 2.6670     | 4.5913          | 76    |
| 2.6814     | 4.6226          | 77    |
| 2.6588     | 4.6188          | 78    |
| 2.6030     | 4.5964          | 79    |
| 2.6216     | 4.6019          | 80    |
| 2.5280     | 4.6018          | 81    |
| 2.5754     | 4.5851          | 82    |
| 2.5673     | 4.5901          | 83    |
| 2.5393     | 4.6256          | 84    |
| 2.4955     | 4.5802          | 85    |
| 2.4958     | 4.6054          | 86    |
| 2.5005     | 4.6039          | 87    |
| 2.4841     | 4.5920          | 88    |
| 2.4570     | 4.6012          | 89    |
| 2.4515     | 4.5890          | 90    |
| 2.4431     | 4.5838          | 91    |
| 2.3742     | 4.5787          | 92    |
| 2.3844     | 4.6137          | 93    |
| 2.3383     | 4.5567          | 94    |
| 2.3353     | 4.6001          | 95    |
| 2.3191     | 4.5930          | 96    |
| 2.3239     | 4.6078          | 97    |
| 2.2769     | 4.6426          | 98    |
| 2.3320     | 4.5895          | 99    |
| 2.2817     | 4.5816          | 100   |
| 2.2582     | 4.6319          | 101   |
| 2.1774     | 4.6308          | 102   |
| 2.2102     | 4.6072          | 103   |
| 2.1617     | 4.6217          | 104   |
| 2.1204     | 4.6111          | 105   |
| 2.1133     | 4.6397          | 106   |
| 2.1467     | 4.6421          | 107   |
| 2.1342     | 4.6318          | 108   |
| 2.1181     | 4.6555          | 109   |
| 2.0767     | 4.6562          | 110   |
| 2.0712     | 4.6533          | 111   |
| 2.0510     | 4.6722          | 112   |
| 2.0286     | 4.6437          | 113   |
| 2.0246     | 4.6431          | 114   |
| 2.0103     | 4.6450          | 115   |
| 2.0312     | 4.7080          | 116   |
| 2.0114     | 4.6146          | 117   |
| 1.9577     | 4.7103          | 118   |
| 1.9565     | 4.6865          | 119   |
| 1.9472     | 4.6602          | 120   |
| 1.9208     | 4.7423          | 121   |
| 1.8886     | 4.6638          | 122   |
| 1.9209     | 4.7388          | 123   |
| 1.8418     | 4.6900          | 124   |
| 1.8558     | 4.7059          | 125   |
| 1.8710     | 4.7353          | 126   |
| 1.8964     | 4.6955          | 127   |
| 1.8434     | 4.7402          | 128   |
| 1.8208     | 4.7557          | 129   |
| 1.8239     | 4.7254          | 130   |
| 1.8503     | 4.7575          | 131   |
| 1.7790     | 4.7725          | 132   |
| 1.7704     | 4.7971          | 133   |
| 1.7516     | 4.7445          | 134   |
| 1.7630     | 4.8046          | 135   |
| 1.7549     | 4.8150          | 136   |
| 1.7104     | 4.7884          | 137   |
| 1.6935     | 4.8472          | 138   |
| 1.6870     | 4.8170          | 139   |
| 1.6855     | 4.7915          | 140   |
| 1.6557     | 4.8719          | 141   |
| 1.6574     | 4.8336          | 142   |
| 1.5848     | 4.8889          | 143   |
| 1.6420     | 4.8585          | 144   |
| 1.6126     | 4.8700          | 145   |
| 1.5733     | 4.8807          | 146   |
| 1.5987     | 4.9093          | 147   |
| 1.5042     | 4.8983          | 148   |
| 1.5607     | 4.9012          | 149   |
| 1.5851     | 4.9208          | 150   |
| 1.5446     | 4.9047          | 151   |
| 1.5388     | 4.9215          | 152   |
| 1.5056     | 4.9796          | 153   |
| 1.5179     | 4.9090          | 154   |
| 1.4876     | 4.9935          | 155   |
| 1.4975     | 4.9810          | 156   |
| 1.4607     | 5.0071          | 157   |
| 1.5030     | 4.9251          | 158   |
| 1.4315     | 5.0219          | 159   |
| 1.4314     | 4.9997          | 160   |
| 1.4178     | 4.9675          | 161   |
| 1.4635     | 5.0669          | 162   |
| 1.4097     | 5.0152          | 163   |
| 1.4132     | 5.0367          | 164   |
| 1.3775     | 5.0395          | 165   |
| 1.4041     | 5.0492          | 166   |
| 1.3943     | 5.0470          | 167   |
| 1.3495     | 5.1050          | 168   |
| 1.3552     | 5.1041          | 169   |
| 1.3615     | 5.0648          | 170   |
| 1.3254     | 5.1234          | 171   |
| 1.3445     | 5.0723          | 172   |
| 1.3316     | 5.1059          | 173   |
| 1.3324     | 5.1294          | 174   |
| 1.2835     | 5.1263          | 175   |
| 1.2682     | 5.1415          | 176   |
| 1.2784     | 5.0970          | 177   |
| 1.2765     | 5.1549          | 178   |
| 1.2319     | 5.1690          | 179   |
| 1.2499     | 5.1262          | 180   |
| 1.1930     | 5.2097          | 181   |
| 1.1929     | 5.1751          | 182   |
| 1.2155     | 5.1879          | 183   |
| 1.1793     | 5.2163          | 184   |
| 1.2233     | 5.2055          | 185   |
| 1.1913     | 5.2115          | 186   |
| 1.1525     | 5.2521          | 187   |
| 1.1655     | 5.2302          | 188   |
| 1.1481     | 5.2551          | 189   |
| 1.1580     | 5.2635          | 190   |
| 1.1389     | 5.2528          | 191   |
| 1.1284     | 5.2694          | 192   |
| 1.1326     | 5.2906          | 193   |
| 1.1092     | 5.2957          | 194   |
| 1.0763     | 5.3227          | 195   |
| 1.0933     | 5.3446          | 196   |
| 1.0921     | 5.3191          | 197   |
| 1.0771     | 5.3399          | 198   |
| 1.0682     | 5.3906          | 199   |
| 1.0679     | 5.3286          | 200   |
| 1.0526     | 5.3256          | 201   |
| 1.0728     | 5.3739          | 202   |
| 1.0440     | 5.3422          | 203   |
| 1.0250     | 5.3946          | 204   |
| 1.0444     | 5.3930          | 205   |
| 1.0013     | 5.4044          | 206   |
| 0.9885     | 5.4122          | 207   |
| 1.0002     | 5.4359          | 208   |
| 0.9855     | 5.4380          | 209   |
| 0.9918     | 5.4045          | 210   |
| 0.9711     | 5.4300          | 211   |
| 0.9513     | 5.4863          | 212   |
| 0.9615     | 5.4596          | 213   |
| 0.9264     | 5.4859          | 214   |
| 0.9255     | 5.4913          | 215   |
| 0.9387     | 5.4630          | 216   |
| 0.9216     | 5.4758          | 217   |
| 0.9157     | 5.4729          | 218   |
| 0.8907     | 5.5127          | 219   |
| 0.9049     | 5.5270          | 220   |
| 0.8869     | 5.5087          | 221   |
| 0.8787     | 5.5236          | 222   |
| 0.8839     | 5.5024          | 223   |
| 0.8711     | 5.5289          | 224   |
| 0.8663     | 5.5205          | 225   |
| 0.8504     | 5.5972          | 226   |
| 0.8532     | 5.5749          | 227   |
| 0.8397     | 5.5873          | 228   |
| 0.8358     | 5.5819          | 229   |
| 0.8230     | 5.5610          | 230   |
| 0.8384     | 5.5884          | 231   |
| 0.8251     | 5.5783          | 232   |
| 0.8137     | 5.5916          | 233   |
| 0.8078     | 5.6334          | 234   |
| 0.8078     | 5.6164          | 235   |


### Framework versions

- Transformers 4.41.2
- TensorFlow 2.15.0
- Datasets 2.20.0
- Tokenizers 0.19.1