File size: 18,862 Bytes
d6c6dea
94238d0
 
d6c6dea
 
94238d0
 
 
 
 
d6c6dea
 
 
 
 
 
 
 
 
 
94238d0
d6c6dea
94238d0
 
 
 
 
d6c6dea
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
94238d0
 
 
d6c6dea
 
 
94238d0
 
d6c6dea
d034c21
 
94238d0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
d034c21
 
d6c6dea
 
8d2b4c2
d6c6dea
 
94238d0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
---
license: apache-2.0
base_model: google-bert/bert-base-uncased
tags:
- generated_from_trainer
metrics:
- accuracy
- f1
- precision
- recall
model-index:
- name: working
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# working

This model is a fine-tuned version of [google-bert/bert-base-uncased](https://huggingface.co/google-bert/bert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0013
- Accuracy: 0.9997
- F1: 0.9997
- Precision: 0.9997
- Recall: 0.9997

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 32
- eval_batch_size: 32
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 10
- num_epochs: 10

### Training results

| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     | Precision | Recall |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
| 1.7386        | 0.05  | 10   | 1.4921          | 0.5744   | 0.5473 | 0.6739    | 0.5638 |
| 1.2954        | 0.11  | 20   | 0.9534          | 0.9091   | 0.9066 | 0.9148    | 0.9082 |
| 0.7734        | 0.16  | 30   | 0.4544          | 0.9570   | 0.9567 | 0.9585    | 0.9578 |
| 0.3456        | 0.21  | 40   | 0.1662          | 0.9907   | 0.9908 | 0.9909    | 0.9907 |
| 0.1226        | 0.26  | 50   | 0.0743          | 0.9914   | 0.9914 | 0.9916    | 0.9914 |
| 0.0709        | 0.32  | 60   | 0.0446          | 0.9917   | 0.9917 | 0.9921    | 0.9914 |
| 0.0565        | 0.37  | 70   | 0.0408          | 0.9897   | 0.9898 | 0.9897    | 0.9900 |
| 0.0172        | 0.42  | 80   | 0.0214          | 0.9967   | 0.9967 | 0.9966    | 0.9968 |
| 0.0234        | 0.48  | 90   | 0.0217          | 0.9954   | 0.9954 | 0.9954    | 0.9954 |
| 0.027         | 0.53  | 100  | 0.0158          | 0.9977   | 0.9977 | 0.9976    | 0.9977 |
| 0.0346        | 0.58  | 110  | 0.0119          | 0.9980   | 0.9980 | 0.9980    | 0.9981 |
| 0.0621        | 0.63  | 120  | 0.0093          | 0.9990   | 0.9990 | 0.9990    | 0.9990 |
| 0.0065        | 0.69  | 130  | 0.0156          | 0.9960   | 0.9960 | 0.9960    | 0.9960 |
| 0.006         | 0.74  | 140  | 0.0081          | 0.9980   | 0.9980 | 0.9979    | 0.9980 |
| 0.0045        | 0.79  | 150  | 0.0091          | 0.9970   | 0.9970 | 0.9969    | 0.9971 |
| 0.0108        | 0.85  | 160  | 0.0045          | 0.9997   | 0.9997 | 0.9997    | 0.9996 |
| 0.0128        | 0.9   | 170  | 0.0033          | 0.9997   | 0.9997 | 0.9997    | 0.9996 |
| 0.0166        | 0.95  | 180  | 0.0112          | 0.9974   | 0.9974 | 0.9973    | 0.9974 |
| 0.0031        | 1.01  | 190  | 0.0117          | 0.9974   | 0.9974 | 0.9973    | 0.9974 |
| 0.0028        | 1.06  | 200  | 0.0143          | 0.9967   | 0.9967 | 0.9967    | 0.9967 |
| 0.0031        | 1.11  | 210  | 0.0076          | 0.9987   | 0.9987 | 0.9987    | 0.9987 |
| 0.0126        | 1.16  | 220  | 0.0051          | 0.9990   | 0.9990 | 0.9990    | 0.9990 |
| 0.0194        | 1.22  | 230  | 0.0048          | 0.9993   | 0.9993 | 0.9993    | 0.9993 |
| 0.0021        | 1.27  | 240  | 0.0093          | 0.9980   | 0.9980 | 0.9980    | 0.9980 |
| 0.002         | 1.32  | 250  | 0.0082          | 0.9983   | 0.9983 | 0.9983    | 0.9983 |
| 0.0187        | 1.38  | 260  | 0.0041          | 0.9993   | 0.9993 | 0.9993    | 0.9993 |
| 0.0018        | 1.43  | 270  | 0.0049          | 0.9990   | 0.9990 | 0.9990    | 0.9990 |
| 0.0016        | 1.48  | 280  | 0.0050          | 0.9987   | 0.9987 | 0.9987    | 0.9986 |
| 0.0016        | 1.53  | 290  | 0.0047          | 0.9993   | 0.9993 | 0.9993    | 0.9993 |
| 0.0014        | 1.59  | 300  | 0.0049          | 0.9993   | 0.9993 | 0.9993    | 0.9993 |
| 0.0014        | 1.64  | 310  | 0.0050          | 0.9990   | 0.9990 | 0.9990    | 0.9990 |
| 0.0013        | 1.69  | 320  | 0.0051          | 0.9990   | 0.9990 | 0.9990    | 0.9990 |
| 0.0089        | 1.75  | 330  | 0.0360          | 0.9911   | 0.9911 | 0.9913    | 0.9911 |
| 0.0211        | 1.8   | 340  | 0.0042          | 0.9987   | 0.9987 | 0.9987    | 0.9987 |
| 0.0014        | 1.85  | 350  | 0.0223          | 0.9957   | 0.9957 | 0.9957    | 0.9957 |
| 0.003         | 1.9   | 360  | 0.0027          | 0.9993   | 0.9993 | 0.9993    | 0.9993 |
| 0.0086        | 1.96  | 370  | 0.0026          | 0.9993   | 0.9994 | 0.9994    | 0.9993 |
| 0.0013        | 2.01  | 380  | 0.0023          | 0.9990   | 0.9990 | 0.9990    | 0.9990 |
| 0.0011        | 2.06  | 390  | 0.0037          | 0.9987   | 0.9987 | 0.9987    | 0.9986 |
| 0.0047        | 2.12  | 400  | 0.0066          | 0.9980   | 0.9980 | 0.9980    | 0.9980 |
| 0.0013        | 2.17  | 410  | 0.0037          | 0.9990   | 0.9990 | 0.9990    | 0.9990 |
| 0.001         | 2.22  | 420  | 0.0020          | 0.9997   | 0.9997 | 0.9997    | 0.9996 |
| 0.0009        | 2.28  | 430  | 0.0014          | 0.9997   | 0.9997 | 0.9997    | 0.9996 |
| 0.0009        | 2.33  | 440  | 0.0012          | 0.9997   | 0.9997 | 0.9997    | 0.9996 |
| 0.0008        | 2.38  | 450  | 0.0011          | 0.9997   | 0.9997 | 0.9997    | 0.9996 |
| 0.0008        | 2.43  | 460  | 0.0011          | 0.9997   | 0.9997 | 0.9997    | 0.9996 |
| 0.0009        | 2.49  | 470  | 0.0010          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0008        | 2.54  | 480  | 0.0012          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0007        | 2.59  | 490  | 0.0012          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0007        | 2.65  | 500  | 0.0012          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0007        | 2.7   | 510  | 0.0012          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.014         | 2.75  | 520  | 0.0019          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0009        | 2.8   | 530  | 0.0036          | 0.9993   | 0.9993 | 0.9994    | 0.9993 |
| 0.0007        | 2.86  | 540  | 0.0036          | 0.9993   | 0.9993 | 0.9994    | 0.9993 |
| 0.0007        | 2.91  | 550  | 0.0032          | 0.9993   | 0.9993 | 0.9994    | 0.9993 |
| 0.0006        | 2.96  | 560  | 0.0028          | 0.9993   | 0.9993 | 0.9994    | 0.9993 |
| 0.0006        | 3.02  | 570  | 0.0026          | 0.9993   | 0.9993 | 0.9994    | 0.9993 |
| 0.0006        | 3.07  | 580  | 0.0024          | 0.9993   | 0.9993 | 0.9994    | 0.9993 |
| 0.0007        | 3.12  | 590  | 0.0023          | 0.9993   | 0.9993 | 0.9994    | 0.9993 |
| 0.0005        | 3.17  | 600  | 0.0021          | 0.9993   | 0.9993 | 0.9994    | 0.9993 |
| 0.0006        | 3.23  | 610  | 0.0021          | 0.9993   | 0.9993 | 0.9994    | 0.9993 |
| 0.0006        | 3.28  | 620  | 0.0018          | 0.9993   | 0.9993 | 0.9994    | 0.9993 |
| 0.0005        | 3.33  | 630  | 0.0017          | 0.9993   | 0.9993 | 0.9994    | 0.9993 |
| 0.0005        | 3.39  | 640  | 0.0016          | 0.9993   | 0.9993 | 0.9994    | 0.9993 |
| 0.0005        | 3.44  | 650  | 0.0014          | 0.9993   | 0.9993 | 0.9994    | 0.9993 |
| 0.0005        | 3.49  | 660  | 0.0013          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0005        | 3.54  | 670  | 0.0012          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0005        | 3.6   | 680  | 0.0011          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0004        | 3.65  | 690  | 0.0011          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0004        | 3.7   | 700  | 0.0011          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0004        | 3.76  | 710  | 0.0010          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0004        | 3.81  | 720  | 0.0010          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0004        | 3.86  | 730  | 0.0010          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0004        | 3.92  | 740  | 0.0009          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0004        | 3.97  | 750  | 0.0009          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0004        | 4.02  | 760  | 0.0009          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0004        | 4.07  | 770  | 0.0009          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0004        | 4.13  | 780  | 0.0009          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0004        | 4.18  | 790  | 0.0009          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0004        | 4.23  | 800  | 0.0009          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0004        | 4.29  | 810  | 0.0008          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0004        | 4.34  | 820  | 0.0008          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0004        | 4.39  | 830  | 0.0008          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0004        | 4.44  | 840  | 0.0008          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0004        | 4.5   | 850  | 0.0008          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0003        | 4.55  | 860  | 0.0008          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0004        | 4.6   | 870  | 0.0008          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0003        | 4.66  | 880  | 0.0008          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0003        | 4.71  | 890  | 0.0007          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0003        | 4.76  | 900  | 0.0007          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0003        | 4.81  | 910  | 0.0007          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0003        | 4.87  | 920  | 0.0007          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0003        | 4.92  | 930  | 0.0007          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0003        | 4.97  | 940  | 0.0007          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0003        | 5.03  | 950  | 0.0007          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0003        | 5.08  | 960  | 0.0007          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0003        | 5.13  | 970  | 0.0007          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0003        | 5.19  | 980  | 0.0007          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0003        | 5.24  | 990  | 0.0007          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0003        | 5.29  | 1000 | 0.0006          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0003        | 5.34  | 1010 | 0.0006          | 0.9997   | 0.9997 | 0.9997    | 0.9997 |
| 0.0003        | 5.4   | 1020 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0003        | 5.45  | 1030 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0003        | 5.5   | 1040 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0003        | 5.56  | 1050 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0003        | 5.61  | 1060 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0003        | 5.66  | 1070 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0003        | 5.71  | 1080 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0003        | 5.77  | 1090 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0003        | 5.82  | 1100 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0003        | 5.87  | 1110 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0003        | 5.93  | 1120 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0003        | 5.98  | 1130 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0003        | 6.03  | 1140 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0003        | 6.08  | 1150 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0003        | 6.14  | 1160 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0003        | 6.19  | 1170 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0003        | 6.24  | 1180 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0003        | 6.3   | 1190 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 6.35  | 1200 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0003        | 6.4   | 1210 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 6.46  | 1220 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 6.51  | 1230 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 6.56  | 1240 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 6.61  | 1250 | 0.0006          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 6.67  | 1260 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 6.72  | 1270 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 6.77  | 1280 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 6.83  | 1290 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 6.88  | 1300 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 6.93  | 1310 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 6.98  | 1320 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.04  | 1330 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.09  | 1340 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.14  | 1350 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.2   | 1360 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.25  | 1370 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.3   | 1380 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.35  | 1390 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.41  | 1400 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.46  | 1410 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.51  | 1420 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.57  | 1430 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.62  | 1440 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.67  | 1450 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.72  | 1460 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.78  | 1470 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.83  | 1480 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.88  | 1490 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.94  | 1500 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 7.99  | 1510 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.04  | 1520 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.1   | 1530 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.15  | 1540 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.2   | 1550 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.25  | 1560 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.31  | 1570 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.36  | 1580 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.41  | 1590 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.47  | 1600 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.52  | 1610 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.57  | 1620 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.62  | 1630 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.68  | 1640 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.73  | 1650 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.78  | 1660 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.84  | 1670 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.89  | 1680 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.94  | 1690 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 8.99  | 1700 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 9.05  | 1710 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 9.1   | 1720 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 9.15  | 1730 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 9.21  | 1740 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 9.26  | 1750 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 9.31  | 1760 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 9.37  | 1770 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 9.42  | 1780 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 9.47  | 1790 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 9.52  | 1800 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 9.58  | 1810 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 9.63  | 1820 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 9.68  | 1830 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 9.74  | 1840 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 9.79  | 1850 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 9.84  | 1860 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 9.89  | 1870 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 9.95  | 1880 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |
| 0.0002        | 10.0  | 1890 | 0.0005          | 1.0      | 1.0    | 1.0       | 1.0    |


### Framework versions

- Transformers 4.38.2
- Pytorch 2.1.2
- Datasets 2.1.0
- Tokenizers 0.15.2