Hugging Face's logo

gngpostalsrvc
/
BERiT

Fill-Mask
Transformers
PyTorch
TensorBoard
roberta
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
4
gngpostalsrvc commited on
Commit
5799f29
•
1 Parent(s): 04fd6d6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -794
README.md CHANGED
@@ -3,33 +3,36 @@ license: mit
3
  tags:
4
  - generated_from_trainer
5
  model-index:
6
- - name: BERiT_2000_custom_architecture_150_epochs_2
7
  results: []
8
  ---
9
 
10
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
11
- should probably proofread and complete it, then remove this comment. -->
12
 
13
- # BERiT_2000_custom_architecture_150_epochs_2
14
 
15
- This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 3.9594
18
 
19
  ## Model description
20
 
21
- More information needed
22
 
23
- ## Intended uses & limitations
24
 
25
- More information needed
26
 
27
- ## Training and evaluation data
 
28
 
29
- More information needed
 
 
30
 
31
  ## Training procedure
32
 
 
 
33
  ### Training hyperparameters
34
 
35
  The following hyperparameters were used during training:
@@ -41,789 +44,9 @@ The following hyperparameters were used during training:
41
  - lr_scheduler_type: linear
42
  - num_epochs: 150
43
 
44
- ### Training results
45
-
46
- | Training Loss | Epoch | Step | Validation Loss |
47
- |:-------------:|:------:|:------:|:---------------:|
48
- | 16.8993 | 0.19 | 500 | 9.2475 |
49
- | 8.3915 | 0.39 | 1000 | 7.7350 |
50
- | 7.4677 | 0.58 | 1500 | 7.1181 |
51
- | 7.0784 | 0.77 | 2000 | 6.9253 |
52
- | 6.9002 | 0.97 | 2500 | 6.7267 |
53
- | 6.7739 | 1.16 | 3000 | 6.5888 |
54
- | 6.6467 | 1.36 | 3500 | 6.4458 |
55
- | 6.6072 | 1.55 | 4000 | 6.3651 |
56
- | 6.5561 | 1.74 | 4500 | 6.3628 |
57
- | 6.473 | 1.94 | 5000 | 6.2704 |
58
- | 6.4513 | 2.13 | 5500 | 6.2083 |
59
- | 6.4083 | 2.32 | 6000 | 6.2637 |
60
- | 6.3725 | 2.52 | 6500 | 6.2232 |
61
- | 6.3608 | 2.71 | 7000 | 6.2333 |
62
- | 6.3549 | 2.9 | 7500 | 6.2324 |
63
- | 6.3446 | 3.1 | 8000 | 6.1373 |
64
- | 6.2954 | 3.29 | 8500 | 6.2198 |
65
- | 6.3306 | 3.49 | 9000 | 6.2064 |
66
- | 6.3054 | 3.68 | 9500 | 6.1870 |
67
- | 6.3217 | 3.87 | 10000 | 6.2034 |
68
- | 6.2912 | 4.07 | 10500 | 6.1558 |
69
- | 6.2947 | 4.26 | 11000 | 6.1845 |
70
- | 6.2678 | 4.45 | 11500 | 6.1749 |
71
- | 6.2906 | 4.65 | 12000 | 6.1740 |
72
- | 6.2711 | 4.84 | 12500 | 6.1651 |
73
- | 6.2438 | 5.03 | 13000 | 6.2029 |
74
- | 6.2494 | 5.23 | 13500 | 6.1084 |
75
- | 6.2654 | 5.42 | 14000 | 6.1303 |
76
- | 6.2466 | 5.62 | 14500 | 6.0888 |
77
- | 6.2129 | 5.81 | 15000 | 6.1254 |
78
- | 6.2349 | 6.0 | 15500 | 6.1093 |
79
- | 6.2299 | 6.2 | 16000 | 6.1692 |
80
- | 6.2087 | 6.39 | 16500 | 6.1964 |
81
- | 6.225 | 6.58 | 17000 | 6.1601 |
82
- | 6.1745 | 6.78 | 17500 | 6.1896 |
83
- | 6.2082 | 6.97 | 18000 | 6.1021 |
84
- | 6.1662 | 7.16 | 18500 | 6.1706 |
85
- | 6.1706 | 7.36 | 19000 | 6.1519 |
86
- | 6.1707 | 7.55 | 19500 | 6.1407 |
87
- | 6.1954 | 7.75 | 20000 | 6.0602 |
88
- | 6.1598 | 7.94 | 20500 | 6.1527 |
89
- | 6.1795 | 8.13 | 21000 | 6.1584 |
90
- | 6.1687 | 8.33 | 21500 | 6.1264 |
91
- | 6.1998 | 8.52 | 22000 | 6.1181 |
92
- | 6.1015 | 8.71 | 22500 | 6.1166 |
93
- | 6.1631 | 8.91 | 23000 | 6.1411 |
94
- | 6.113 | 9.1 | 23500 | 6.1398 |
95
- | 6.1425 | 9.3 | 24000 | 6.1296 |
96
- | 6.1875 | 9.49 | 24500 | 6.1369 |
97
- | 6.1274 | 9.68 | 25000 | 6.1185 |
98
- | 6.166 | 9.88 | 25500 | 6.1335 |
99
- | 6.136 | 10.07 | 26000 | 6.1390 |
100
- | 6.1415 | 10.26 | 26500 | 6.1046 |
101
- | 6.1227 | 10.46 | 27000 | 6.0651 |
102
- | 6.1453 | 10.65 | 27500 | 6.1200 |
103
- | 6.1255 | 10.84 | 28000 | 6.1144 |
104
- | 6.1348 | 11.04 | 28500 | 6.1382 |
105
- | 6.1103 | 11.23 | 29000 | 6.0815 |
106
- | 6.1053 | 11.43 | 29500 | 6.1336 |
107
- | 6.0902 | 11.62 | 30000 | 6.1034 |
108
- | 6.0874 | 11.81 | 30500 | 6.1000 |
109
- | 6.1075 | 12.01 | 31000 | 6.1143 |
110
- | 6.1184 | 12.2 | 31500 | 6.0966 |
111
- | 6.0981 | 12.39 | 32000 | 6.0657 |
112
- | 6.0878 | 12.59 | 32500 | 6.0561 |
113
- | 6.0859 | 12.78 | 33000 | 6.0949 |
114
- | 6.0735 | 12.97 | 33500 | 6.1539 |
115
- | 6.1149 | 13.17 | 34000 | 6.0670 |
116
- | 6.0798 | 13.36 | 34500 | 6.0846 |
117
- | 6.0785 | 13.56 | 35000 | 6.0809 |
118
- | 6.0645 | 13.75 | 35500 | 6.0945 |
119
- | 6.1143 | 13.94 | 36000 | 6.0755 |
120
- | 6.0516 | 14.14 | 36500 | 6.0402 |
121
- | 6.0732 | 14.33 | 37000 | 6.0379 |
122
- | 6.0502 | 14.52 | 37500 | 6.1092 |
123
- | 6.0567 | 14.72 | 38000 | 6.1039 |
124
- | 6.0535 | 14.91 | 38500 | 6.1469 |
125
- | 6.0547 | 15.1 | 39000 | 6.0764 |
126
- | 6.053 | 15.3 | 39500 | 6.0044 |
127
- | 6.0503 | 15.49 | 40000 | 6.0259 |
128
- | 6.0253 | 15.69 | 40500 | 6.0717 |
129
- | 6.0738 | 15.88 | 41000 | 6.0829 |
130
- | 6.0515 | 16.07 | 41500 | 6.0087 |
131
- | 6.0255 | 16.27 | 42000 | 6.1112 |
132
- | 6.041 | 16.46 | 42500 | 6.0599 |
133
- | 6.024 | 16.65 | 43000 | 5.9982 |
134
- | 6.0313 | 16.85 | 43500 | 5.9979 |
135
- | 6.0008 | 17.04 | 44000 | 5.9577 |
136
- | 6.0266 | 17.23 | 44500 | 6.0224 |
137
- | 5.9931 | 17.43 | 45000 | 6.0169 |
138
- | 6.0059 | 17.62 | 45500 | 5.9380 |
139
- | 6.0306 | 17.82 | 46000 | 6.0183 |
140
- | 6.0106 | 18.01 | 46500 | 6.0202 |
141
- | 5.9917 | 18.2 | 47000 | 5.9935 |
142
- | 5.972 | 18.4 | 47500 | 5.9355 |
143
- | 5.9927 | 18.59 | 48000 | 5.9439 |
144
- | 5.9474 | 18.78 | 48500 | 5.9729 |
145
- | 5.9731 | 18.98 | 49000 | 5.9193 |
146
- | 5.9505 | 19.17 | 49500 | 5.8764 |
147
- | 5.9592 | 19.36 | 50000 | 5.9277 |
148
- | 5.9397 | 19.56 | 50500 | 5.9222 |
149
- | 5.9269 | 19.75 | 51000 | 6.0022 |
150
- | 5.9264 | 19.95 | 51500 | 5.9420 |
151
- | 5.9536 | 20.14 | 52000 | 5.9062 |
152
- | 6.0024 | 20.33 | 52500 | 5.9503 |
153
- | 5.9306 | 20.53 | 53000 | 5.9112 |
154
- | 5.9982 | 20.72 | 53500 | 5.8817 |
155
- | 5.9473 | 20.91 | 54000 | 5.8615 |
156
- | 5.9416 | 21.11 | 54500 | 5.8750 |
157
- | 5.9236 | 21.3 | 55000 | 5.9066 |
158
- | 5.9437 | 21.49 | 55500 | 5.8973 |
159
- | 5.9273 | 21.69 | 56000 | 5.8934 |
160
- | 5.9153 | 21.88 | 56500 | 5.9254 |
161
- | 5.9 | 22.08 | 57000 | 5.8704 |
162
- | 5.9256 | 22.27 | 57500 | 5.8112 |
163
- | 5.9214 | 22.46 | 58000 | 5.8734 |
164
- | 5.9199 | 22.66 | 58500 | 5.8161 |
165
- | 5.9091 | 22.85 | 59000 | 5.8455 |
166
- | 5.8885 | 23.04 | 59500 | 5.8545 |
167
- | 5.8893 | 23.24 | 60000 | 5.7981 |
168
- | 5.9021 | 23.43 | 60500 | 5.8291 |
169
- | 5.9116 | 23.63 | 61000 | 5.7875 |
170
- | 5.8841 | 23.82 | 61500 | 5.8000 |
171
- | 5.8866 | 24.01 | 62000 | 5.8010 |
172
- | 5.856 | 24.21 | 62500 | 5.8134 |
173
- | 5.8448 | 24.4 | 63000 | 5.7919 |
174
- | 5.8176 | 24.59 | 63500 | 5.7573 |
175
- | 5.8627 | 24.79 | 64000 | 5.7591 |
176
- | 5.8869 | 24.98 | 64500 | 5.7605 |
177
- | 5.8586 | 25.17 | 65000 | 5.7183 |
178
- | 5.8581 | 25.37 | 65500 | 5.8123 |
179
- | 5.8412 | 25.56 | 66000 | 5.7293 |
180
- | 5.8571 | 25.76 | 66500 | 5.7288 |
181
- | 5.8504 | 25.95 | 67000 | 5.7237 |
182
- | 5.8659 | 26.14 | 67500 | 5.7023 |
183
- | 5.8359 | 26.34 | 68000 | 5.7458 |
184
- | 5.849 | 26.53 | 68500 | 5.7599 |
185
- | 5.8431 | 26.72 | 69000 | 5.6609 |
186
- | 5.83 | 26.92 | 69500 | 5.7069 |
187
- | 5.8191 | 27.11 | 70000 | 5.6856 |
188
- | 5.8351 | 27.3 | 70500 | 5.6648 |
189
- | 5.7971 | 27.5 | 71000 | 5.6647 |
190
- | 5.8308 | 27.69 | 71500 | 5.6541 |
191
- | 5.8455 | 27.89 | 72000 | 5.6452 |
192
- | 5.8195 | 28.08 | 72500 | 5.6658 |
193
- | 5.7869 | 28.27 | 73000 | 5.6464 |
194
- | 5.7909 | 28.47 | 73500 | 5.6338 |
195
- | 5.7912 | 28.66 | 74000 | 5.5773 |
196
- | 5.8147 | 28.85 | 74500 | 5.6581 |
197
- | 5.8075 | 29.05 | 75000 | 5.6271 |
198
- | 5.7556 | 29.24 | 75500 | 5.6431 |
199
- | 5.8139 | 29.43 | 76000 | 5.5595 |
200
- | 5.7551 | 29.63 | 76500 | 5.6135 |
201
- | 5.7596 | 29.82 | 77000 | 5.6541 |
202
- | 5.7166 | 30.02 | 77500 | 5.6017 |
203
- | 5.7342 | 30.21 | 78000 | 5.5747 |
204
- | 5.7831 | 30.4 | 78500 | 5.5467 |
205
- | 5.7635 | 30.6 | 79000 | 5.5388 |
206
- | 5.743 | 30.79 | 79500 | 5.5707 |
207
- | 5.7554 | 30.98 | 80000 | 5.5370 |
208
- | 5.6973 | 31.18 | 80500 | 5.5397 |
209
- | 5.7183 | 31.37 | 81000 | 5.4739 |
210
- | 5.6987 | 31.56 | 81500 | 5.5743 |
211
- | 5.7101 | 31.76 | 82000 | 5.5699 |
212
- | 5.6655 | 31.95 | 82500 | 5.5442 |
213
- | 5.7348 | 32.15 | 83000 | 5.5049 |
214
- | 5.7121 | 32.34 | 83500 | 5.4862 |
215
- | 5.7238 | 32.53 | 84000 | 5.4584 |
216
- | 5.6962 | 32.73 | 84500 | 5.4517 |
217
- | 5.6889 | 32.92 | 85000 | 5.4671 |
218
- | 5.6692 | 33.11 | 85500 | 5.4495 |
219
- | 5.6685 | 33.31 | 86000 | 5.4814 |
220
- | 5.7015 | 33.5 | 86500 | 5.3577 |
221
- | 5.6877 | 33.69 | 87000 | 5.4244 |
222
- | 5.6597 | 33.89 | 87500 | 5.4211 |
223
- | 5.668 | 34.08 | 88000 | 5.4297 |
224
- | 5.6546 | 34.28 | 88500 | 5.3825 |
225
- | 5.6239 | 34.47 | 89000 | 5.3649 |
226
- | 5.6348 | 34.66 | 89500 | 5.3562 |
227
- | 5.6578 | 34.86 | 90000 | 5.3714 |
228
- | 5.6018 | 35.05 | 90500 | 5.3731 |
229
- | 5.6288 | 35.24 | 91000 | 5.3219 |
230
- | 5.643 | 35.44 | 91500 | 5.3096 |
231
- | 5.5982 | 35.63 | 92000 | 5.3084 |
232
- | 5.6054 | 35.82 | 92500 | 5.2815 |
233
- | 5.5997 | 36.02 | 93000 | 5.3208 |
234
- | 5.6203 | 36.21 | 93500 | 5.1933 |
235
- | 5.5854 | 36.41 | 94000 | 5.2836 |
236
- | 5.5906 | 36.6 | 94500 | 5.2806 |
237
- | 5.5906 | 36.79 | 95000 | 5.2381 |
238
- | 5.5284 | 36.99 | 95500 | 5.2542 |
239
- | 5.5303 | 37.18 | 96000 | 5.2539 |
240
- | 5.5577 | 37.37 | 96500 | 5.1980 |
241
- | 5.5835 | 37.57 | 97000 | 5.1736 |
242
- | 5.5526 | 37.76 | 97500 | 5.1583 |
243
- | 5.546 | 37.96 | 98000 | 5.1453 |
244
- | 5.5525 | 38.15 | 98500 | 5.1739 |
245
- | 5.5167 | 38.34 | 99000 | 5.1741 |
246
- | 5.5392 | 38.54 | 99500 | 5.1424 |
247
- | 5.5079 | 38.73 | 100000 | 5.1309 |
248
- | 5.506 | 38.92 | 100500 | 5.1275 |
249
- | 5.5229 | 39.12 | 101000 | 5.0573 |
250
- | 5.497 | 39.31 | 101500 | 5.1519 |
251
- | 5.4899 | 39.5 | 102000 | 5.1424 |
252
- | 5.4906 | 39.7 | 102500 | 5.0423 |
253
- | 5.4846 | 39.89 | 103000 | 5.0278 |
254
- | 5.4723 | 40.09 | 103500 | 5.0551 |
255
- | 5.478 | 40.28 | 104000 | 5.0249 |
256
- | 5.4427 | 40.47 | 104500 | 5.0610 |
257
- | 5.4519 | 40.67 | 105000 | 5.0060 |
258
- | 5.4495 | 40.86 | 105500 | 5.0251 |
259
- | 5.4528 | 41.05 | 106000 | 4.9568 |
260
- | 5.451 | 41.25 | 106500 | 4.9651 |
261
- | 5.4204 | 41.44 | 107000 | 4.9567 |
262
- | 5.397 | 41.63 | 107500 | 4.9859 |
263
- | 5.4787 | 41.83 | 108000 | 5.0226 |
264
- | 5.4346 | 42.02 | 108500 | 4.9202 |
265
- | 5.4145 | 42.22 | 109000 | 4.8807 |
266
- | 5.3977 | 42.41 | 109500 | 4.9241 |
267
- | 5.3933 | 42.6 | 110000 | 4.8973 |
268
- | 5.3976 | 42.8 | 110500 | 4.9478 |
269
- | 5.4017 | 42.99 | 111000 | 4.8495 |
270
- | 5.3732 | 43.18 | 111500 | 4.9097 |
271
- | 5.3797 | 43.38 | 112000 | 4.8503 |
272
- | 5.345 | 43.57 | 112500 | 4.8608 |
273
- | 5.3764 | 43.76 | 113000 | 4.8466 |
274
- | 5.3622 | 43.96 | 113500 | 4.8513 |
275
- | 5.3411 | 44.15 | 114000 | 4.7642 |
276
- | 5.3636 | 44.35 | 114500 | 4.8556 |
277
- | 5.4052 | 44.54 | 115000 | 4.8688 |
278
- | 5.3638 | 44.73 | 115500 | 4.8331 |
279
- | 5.3276 | 44.93 | 116000 | 4.8542 |
280
- | 5.3398 | 45.12 | 116500 | 4.8225 |
281
- | 5.3728 | 45.31 | 117000 | 4.8086 |
282
- | 5.3264 | 45.51 | 117500 | 4.8129 |
283
- | 5.3056 | 45.7 | 118000 | 4.7709 |
284
- | 5.3218 | 45.89 | 118500 | 4.8290 |
285
- | 5.329 | 46.09 | 119000 | 4.7862 |
286
- | 5.3338 | 46.28 | 119500 | 4.7639 |
287
- | 5.3012 | 46.48 | 120000 | 4.8215 |
288
- | 5.2766 | 46.67 | 120500 | 4.7859 |
289
- | 5.3515 | 46.86 | 121000 | 4.7853 |
290
- | 5.2951 | 47.06 | 121500 | 4.7290 |
291
- | 5.2817 | 47.25 | 122000 | 4.7984 |
292
- | 5.2876 | 47.44 | 122500 | 4.7347 |
293
- | 5.3011 | 47.64 | 123000 | 4.7954 |
294
- | 5.3004 | 47.83 | 123500 | 4.7051 |
295
- | 5.2992 | 48.02 | 124000 | 4.7024 |
296
- | 5.295 | 48.22 | 124500 | 4.6968 |
297
- | 5.2877 | 48.41 | 125000 | 4.7779 |
298
- | 5.2599 | 48.61 | 125500 | 4.7624 |
299
- | 5.2432 | 48.8 | 126000 | 4.6750 |
300
- | 5.254 | 48.99 | 126500 | 4.7020 |
301
- | 5.2301 | 49.19 | 127000 | 4.7351 |
302
- | 5.2373 | 49.38 | 127500 | 4.7120 |
303
- | 5.2531 | 49.57 | 128000 | 4.7336 |
304
- | 5.2445 | 49.77 | 128500 | 4.6670 |
305
- | 5.2293 | 49.96 | 129000 | 4.6865 |
306
- | 5.2601 | 50.15 | 129500 | 4.6678 |
307
- | 5.2209 | 50.35 | 130000 | 4.7078 |
308
- | 5.2535 | 50.54 | 130500 | 4.6525 |
309
- | 5.2517 | 50.74 | 131000 | 4.6395 |
310
- | 5.2493 | 50.93 | 131500 | 4.6285 |
311
- | 5.2175 | 51.12 | 132000 | 4.6492 |
312
- | 5.2466 | 51.32 | 132500 | 4.6801 |
313
- | 5.2018 | 51.51 | 133000 | 4.5866 |
314
- | 5.237 | 51.7 | 133500 | 4.6574 |
315
- | 5.219 | 51.9 | 134000 | 4.6878 |
316
- | 5.2029 | 52.09 | 134500 | 4.6140 |
317
- | 5.2071 | 52.29 | 135000 | 4.6391 |
318
- | 5.2158 | 52.48 | 135500 | 4.6660 |
319
- | 5.1979 | 52.67 | 136000 | 4.6365 |
320
- | 5.1744 | 52.87 | 136500 | 4.6596 |
321
- | 5.1986 | 53.06 | 137000 | 4.5590 |
322
- | 5.14 | 53.25 | 137500 | 4.6518 |
323
- | 5.1526 | 53.45 | 138000 | 4.6319 |
324
- | 5.2237 | 53.64 | 138500 | 4.5454 |
325
- | 5.1758 | 53.83 | 139000 | 4.5736 |
326
- | 5.1395 | 54.03 | 139500 | 4.6172 |
327
- | 5.1433 | 54.22 | 140000 | 4.5772 |
328
- | 5.1522 | 54.42 | 140500 | 4.5900 |
329
- | 5.1643 | 54.61 | 141000 | 4.5464 |
330
- | 5.173 | 54.8 | 141500 | 4.5645 |
331
- | 5.1442 | 55.0 | 142000 | 4.5944 |
332
- | 5.1488 | 55.19 | 142500 | 4.5675 |
333
- | 5.1431 | 55.38 | 143000 | 4.6258 |
334
- | 5.146 | 55.58 | 143500 | 4.5744 |
335
- | 5.1178 | 55.77 | 144000 | 4.5584 |
336
- | 5.1214 | 55.96 | 144500 | 4.5616 |
337
- | 5.1717 | 56.16 | 145000 | 4.5731 |
338
- | 5.1781 | 56.35 | 145500 | 4.5950 |
339
- | 5.1374 | 56.55 | 146000 | 4.5213 |
340
- | 5.1138 | 56.74 | 146500 | 4.5924 |
341
- | 5.1025 | 56.93 | 147000 | 4.5232 |
342
- | 5.1319 | 57.13 | 147500 | 4.5387 |
343
- | 5.1392 | 57.32 | 148000 | 4.5114 |
344
- | 5.0974 | 57.51 | 148500 | 4.5632 |
345
- | 5.116 | 57.71 | 149000 | 4.4851 |
346
- | 5.16 | 57.9 | 149500 | 4.5370 |
347
- | 5.1488 | 58.09 | 150000 | 4.4891 |
348
- | 5.1389 | 58.29 | 150500 | 4.5373 |
349
- | 5.1413 | 58.48 | 151000 | 4.4960 |
350
- | 5.0893 | 58.68 | 151500 | 4.4976 |
351
- | 5.0912 | 58.87 | 152000 | 4.4964 |
352
- | 5.1441 | 59.06 | 152500 | 4.5484 |
353
- | 5.0736 | 59.26 | 153000 | 4.5156 |
354
- | 5.1045 | 59.45 | 153500 | 4.4607 |
355
- | 5.0997 | 59.64 | 154000 | 4.5472 |
356
- | 5.1239 | 59.84 | 154500 | 4.5316 |
357
- | 5.081 | 60.03 | 155000 | 4.5056 |
358
- | 5.1429 | 60.22 | 155500 | 4.4974 |
359
- | 5.0855 | 60.42 | 156000 | 4.5273 |
360
- | 5.0863 | 60.61 | 156500 | 4.5312 |
361
- | 5.099 | 60.81 | 157000 | 4.4911 |
362
- | 5.0858 | 61.0 | 157500 | 4.5183 |
363
- | 5.0429 | 61.19 | 158000 | 4.4828 |
364
- | 5.0853 | 61.39 | 158500 | 4.4607 |
365
- | 5.0965 | 61.58 | 159000 | 4.5046 |
366
- | 5.0908 | 61.77 | 159500 | 4.5164 |
367
- | 5.0468 | 61.97 | 160000 | 4.4875 |
368
- | 5.0699 | 62.16 | 160500 | 4.4437 |
369
- | 5.0883 | 62.35 | 161000 | 4.5250 |
370
- | 5.0506 | 62.55 | 161500 | 4.4332 |
371
- | 5.1 | 62.74 | 162000 | 4.4677 |
372
- | 5.1024 | 62.94 | 162500 | 4.5277 |
373
- | 5.0548 | 63.13 | 163000 | 4.4887 |
374
- | 5.0638 | 63.32 | 163500 | 4.4349 |
375
- | 5.1075 | 63.52 | 164000 | 4.4540 |
376
- | 5.0715 | 63.71 | 164500 | 4.4279 |
377
- | 5.0742 | 63.9 | 165000 | 4.4283 |
378
- | 5.0567 | 64.1 | 165500 | 4.4640 |
379
- | 5.0568 | 64.29 | 166000 | 4.4375 |
380
- | 5.0751 | 64.48 | 166500 | 4.4667 |
381
- | 5.0607 | 64.68 | 167000 | 4.4408 |
382
- | 5.0536 | 64.87 | 167500 | 4.4483 |
383
- | 5.0545 | 65.07 | 168000 | 4.4397 |
384
- | 5.0601 | 65.26 | 168500 | 4.4112 |
385
- | 5.0209 | 65.45 | 169000 | 4.4289 |
386
- | 5.0346 | 65.65 | 169500 | 4.4793 |
387
- | 5.0369 | 65.84 | 170000 | 4.4338 |
388
- | 5.0532 | 66.03 | 170500 | 4.4668 |
389
- | 5.033 | 66.23 | 171000 | 4.4351 |
390
- | 5.022 | 66.42 | 171500 | 4.4455 |
391
- | 5.0356 | 66.62 | 172000 | 4.4254 |
392
- | 5.0299 | 66.81 | 172500 | 4.4406 |
393
- | 5.0136 | 67.0 | 173000 | 4.4062 |
394
- | 5.0484 | 67.2 | 173500 | 4.4230 |
395
- | 5.0087 | 67.39 | 174000 | 4.4142 |
396
- | 5.0245 | 67.58 | 174500 | 4.3675 |
397
- | 5.0192 | 67.78 | 175000 | 4.3678 |
398
- | 5.0199 | 67.97 | 175500 | 4.3304 |
399
- | 5.0496 | 68.16 | 176000 | 4.4205 |
400
- | 5.0303 | 68.36 | 176500 | 4.3926 |
401
- | 4.9975 | 68.55 | 177000 | 4.4386 |
402
- | 5.0215 | 68.75 | 177500 | 4.3959 |
403
- | 5.0148 | 68.94 | 178000 | 4.3702 |
404
- | 4.9966 | 69.13 | 178500 | 4.3284 |
405
- | 5.0076 | 69.33 | 179000 | 4.4112 |
406
- | 4.9746 | 69.52 | 179500 | 4.3751 |
407
- | 5.0027 | 69.71 | 180000 | 4.3619 |
408
- | 5.0041 | 69.91 | 180500 | 4.3343 |
409
- | 4.992 | 70.1 | 181000 | 4.3628 |
410
- | 4.9746 | 70.29 | 181500 | 4.3625 |
411
- | 4.981 | 70.49 | 182000 | 4.4130 |
412
- | 4.9927 | 70.68 | 182500 | 4.3526 |
413
- | 5.0219 | 70.88 | 183000 | 4.3857 |
414
- | 4.9799 | 71.07 | 183500 | 4.3312 |
415
- | 4.9916 | 71.26 | 184000 | 4.3629 |
416
- | 5.0159 | 71.46 | 184500 | 4.3864 |
417
- | 4.9923 | 71.65 | 185000 | 4.3349 |
418
- | 4.9804 | 71.84 | 185500 | 4.3499 |
419
- | 4.9578 | 72.04 | 186000 | 4.3624 |
420
- | 4.9768 | 72.23 | 186500 | 4.2933 |
421
- | 4.9934 | 72.42 | 187000 | 4.3161 |
422
- | 4.9617 | 72.62 | 187500 | 4.3222 |
423
- | 4.9559 | 72.81 | 188000 | 4.3870 |
424
- | 5.0038 | 73.01 | 188500 | 4.3617 |
425
- | 4.9721 | 73.2 | 189000 | 4.2862 |
426
- | 4.9652 | 73.39 | 189500 | 4.3509 |
427
- | 4.9582 | 73.59 | 190000 | 4.3473 |
428
- | 4.9435 | 73.78 | 190500 | 4.3210 |
429
- | 4.9765 | 73.97 | 191000 | 4.3871 |
430
- | 4.9601 | 74.17 | 191500 | 4.3038 |
431
- | 4.9717 | 74.36 | 192000 | 4.3145 |
432
- | 5.0097 | 74.55 | 192500 | 4.3288 |
433
- | 4.9635 | 74.75 | 193000 | 4.2942 |
434
- | 4.9527 | 74.94 | 193500 | 4.3687 |
435
- | 4.9329 | 75.14 | 194000 | 4.3104 |
436
- | 4.9493 | 75.33 | 194500 | 4.2900 |
437
- | 4.988 | 75.52 | 195000 | 4.3005 |
438
- | 4.9608 | 75.72 | 195500 | 4.3503 |
439
- | 4.9315 | 75.91 | 196000 | 4.2569 |
440
- | 4.9807 | 76.1 | 196500 | 4.3205 |
441
- | 4.9385 | 76.3 | 197000 | 4.3222 |
442
- | 4.9373 | 76.49 | 197500 | 4.3407 |
443
- | 4.9361 | 76.68 | 198000 | 4.2872 |
444
- | 4.9555 | 76.88 | 198500 | 4.2952 |
445
- | 4.9197 | 77.07 | 199000 | 4.2932 |
446
- | 4.9507 | 77.27 | 199500 | 4.3372 |
447
- | 4.9437 | 77.46 | 200000 | 4.2825 |
448
- | 4.9452 | 77.65 | 200500 | 4.3371 |
449
- | 4.9293 | 77.85 | 201000 | 4.3046 |
450
- | 4.9557 | 78.04 | 201500 | 4.3181 |
451
- | 4.9094 | 78.23 | 202000 | 4.3166 |
452
- | 4.9695 | 78.43 | 202500 | 4.3134 |
453
- | 4.8941 | 78.62 | 203000 | 4.2742 |
454
- | 4.9762 | 78.81 | 203500 | 4.3320 |
455
- | 4.9405 | 79.01 | 204000 | 4.2862 |
456
- | 4.9052 | 79.2 | 204500 | 4.2652 |
457
- | 4.9219 | 79.4 | 205000 | 4.3223 |
458
- | 4.9248 | 79.59 | 205500 | 4.2838 |
459
- | 4.974 | 79.78 | 206000 | 4.2224 |
460
- | 4.9077 | 79.98 | 206500 | 4.3211 |
461
- | 4.9306 | 80.17 | 207000 | 4.3098 |
462
- | 4.913 | 80.36 | 207500 | 4.2907 |
463
- | 4.9232 | 80.56 | 208000 | 4.3113 |
464
- | 4.9402 | 80.75 | 208500 | 4.2539 |
465
- | 4.8873 | 80.95 | 209000 | 4.2687 |
466
- | 4.9165 | 81.14 | 209500 | 4.2968 |
467
- | 4.9064 | 81.33 | 210000 | 4.2819 |
468
- | 4.8976 | 81.53 | 210500 | 4.2537 |
469
- | 4.8774 | 81.72 | 211000 | 4.2645 |
470
- | 4.9448 | 81.91 | 211500 | 4.2632 |
471
- | 4.9138 | 82.11 | 212000 | 4.2982 |
472
- | 4.9106 | 82.3 | 212500 | 4.2449 |
473
- | 4.8979 | 82.49 | 213000 | 4.2527 |
474
- | 4.9075 | 82.69 | 213500 | 4.2241 |
475
- | 4.9174 | 82.88 | 214000 | 4.2611 |
476
- | 4.9034 | 83.08 | 214500 | 4.2331 |
477
- | 4.872 | 83.27 | 215000 | 4.3029 |
478
- | 4.9115 | 83.46 | 215500 | 4.2705 |
479
- | 4.8671 | 83.66 | 216000 | 4.3382 |
480
- | 4.8947 | 83.85 | 216500 | 4.2076 |
481
- | 4.8886 | 84.04 | 217000 | 4.2754 |
482
- | 4.8522 | 84.24 | 217500 | 4.2324 |
483
- | 4.9056 | 84.43 | 218000 | 4.2703 |
484
- | 4.8901 | 84.62 | 218500 | 4.2259 |
485
- | 4.8917 | 84.82 | 219000 | 4.2423 |
486
- | 4.9121 | 85.01 | 219500 | 4.2505 |
487
- | 4.8974 | 85.21 | 220000 | 4.2498 |
488
- | 4.9094 | 85.4 | 220500 | 4.2216 |
489
- | 4.9015 | 85.59 | 221000 | 4.2309 |
490
- | 4.8855 | 85.79 | 221500 | 4.2113 |
491
- | 4.8856 | 85.98 | 222000 | 4.1967 |
492
- | 4.8791 | 86.17 | 222500 | 4.2305 |
493
- | 4.8748 | 86.37 | 223000 | 4.2468 |
494
- | 4.8928 | 86.56 | 223500 | 4.2403 |
495
- | 4.8769 | 86.75 | 224000 | 4.2240 |
496
- | 4.9248 | 86.95 | 224500 | 4.2023 |
497
- | 4.8846 | 87.14 | 225000 | 4.1607 |
498
- | 4.8445 | 87.34 | 225500 | 4.2275 |
499
- | 4.8655 | 87.53 | 226000 | 4.2341 |
500
- | 4.8631 | 87.72 | 226500 | 4.2389 |
501
- | 4.8593 | 87.92 | 227000 | 4.2293 |
502
- | 4.8273 | 88.11 | 227500 | 4.1820 |
503
- | 4.8535 | 88.3 | 228000 | 4.2453 |
504
- | 4.8472 | 88.5 | 228500 | 4.2352 |
505
- | 4.8574 | 88.69 | 229000 | 4.2363 |
506
- | 4.8602 | 88.88 | 229500 | 4.1891 |
507
- | 4.8706 | 89.08 | 230000 | 4.2236 |
508
- | 4.8412 | 89.27 | 230500 | 4.2656 |
509
- | 4.8423 | 89.47 | 231000 | 4.1807 |
510
- | 4.8659 | 89.66 | 231500 | 4.2319 |
511
- | 4.8415 | 89.85 | 232000 | 4.2520 |
512
- | 4.8755 | 90.05 | 232500 | 4.1592 |
513
- | 4.824 | 90.24 | 233000 | 4.2263 |
514
- | 4.8552 | 90.43 | 233500 | 4.1266 |
515
- | 4.8484 | 90.63 | 234000 | 4.1561 |
516
- | 4.8845 | 90.82 | 234500 | 4.1777 |
517
- | 4.825 | 91.01 | 235000 | 4.1898 |
518
- | 4.7925 | 91.21 | 235500 | 4.1714 |
519
- | 4.8386 | 91.4 | 236000 | 4.1733 |
520
- | 4.851 | 91.6 | 236500 | 4.1700 |
521
- | 4.8698 | 91.79 | 237000 | 4.2070 |
522
- | 4.85 | 91.98 | 237500 | 4.2251 |
523
- | 4.8807 | 92.18 | 238000 | 4.1405 |
524
- | 4.8459 | 92.37 | 238500 | 4.1693 |
525
- | 4.8641 | 92.56 | 239000 | 4.1333 |
526
- | 4.8173 | 92.76 | 239500 | 4.1852 |
527
- | 4.846 | 92.95 | 240000 | 4.1333 |
528
- | 4.8567 | 93.14 | 240500 | 4.1382 |
529
- | 4.8318 | 93.34 | 241000 | 4.1646 |
530
- | 4.8185 | 93.53 | 241500 | 4.1559 |
531
- | 4.8429 | 93.73 | 242000 | 4.1610 |
532
- | 4.8144 | 93.92 | 242500 | 4.2007 |
533
- | 4.8164 | 94.11 | 243000 | 4.1443 |
534
- | 4.83 | 94.31 | 243500 | 4.1894 |
535
- | 4.8379 | 94.5 | 244000 | 4.1407 |
536
- | 4.8429 | 94.69 | 244500 | 4.1836 |
537
- | 4.8187 | 94.89 | 245000 | 4.1609 |
538
- | 4.8062 | 95.08 | 245500 | 4.1310 |
539
- | 4.8193 | 95.27 | 246000 | 4.1439 |
540
- | 4.8214 | 95.47 | 246500 | 4.1433 |
541
- | 4.8055 | 95.66 | 247000 | 4.1763 |
542
- | 4.852 | 95.86 | 247500 | 4.1467 |
543
- | 4.8623 | 96.05 | 248000 | 4.1333 |
544
- | 4.8393 | 96.24 | 248500 | 4.1482 |
545
- | 4.8121 | 96.44 | 249000 | 4.1425 |
546
- | 4.7819 | 96.63 | 249500 | 4.1722 |
547
- | 4.8374 | 96.82 | 250000 | 4.1684 |
548
- | 4.8023 | 97.02 | 250500 | 4.1134 |
549
- | 4.7918 | 97.21 | 251000 | 4.1119 |
550
- | 4.8469 | 97.41 | 251500 | 4.1232 |
551
- | 4.8216 | 97.6 | 252000 | 4.1256 |
552
- | 4.8428 | 97.79 | 252500 | 4.1208 |
553
- | 4.8072 | 97.99 | 253000 | 4.1087 |
554
- | 4.7763 | 98.18 | 253500 | 4.1605 |
555
- | 4.8016 | 98.37 | 254000 | 4.1602 |
556
- | 4.8388 | 98.57 | 254500 | 4.1314 |
557
- | 4.806 | 98.76 | 255000 | 4.1518 |
558
- | 4.8046 | 98.95 | 255500 | 4.1294 |
559
- | 4.7876 | 99.15 | 256000 | 4.1277 |
560
- | 4.8079 | 99.34 | 256500 | 4.1185 |
561
- | 4.7753 | 99.54 | 257000 | 4.1257 |
562
- | 4.8214 | 99.73 | 257500 | 4.1145 |
563
- | 4.8265 | 99.92 | 258000 | 4.1403 |
564
- | 4.8108 | 100.12 | 258500 | 4.1234 |
565
- | 4.842 | 100.31 | 259000 | 4.1461 |
566
- | 4.8162 | 100.5 | 259500 | 4.1327 |
567
- | 4.8131 | 100.7 | 260000 | 4.0989 |
568
- | 4.8057 | 100.89 | 260500 | 4.1095 |
569
- | 4.8138 | 101.08 | 261000 | 4.1003 |
570
- | 4.7981 | 101.28 | 261500 | 4.1077 |
571
- | 4.7933 | 101.47 | 262000 | 4.0899 |
572
- | 4.8319 | 101.67 | 262500 | 4.1472 |
573
- | 4.7765 | 101.86 | 263000 | 4.1299 |
574
- | 4.7991 | 102.05 | 263500 | 4.1232 |
575
- | 4.8072 | 102.25 | 264000 | 4.0958 |
576
- | 4.8371 | 102.44 | 264500 | 4.1353 |
577
- | 4.8251 | 102.63 | 265000 | 4.1156 |
578
- | 4.7866 | 102.83 | 265500 | 4.0886 |
579
- | 4.7927 | 103.02 | 266000 | 4.0323 |
580
- | 4.8037 | 103.21 | 266500 | 4.1441 |
581
- | 4.7591 | 103.41 | 267000 | 4.0957 |
582
- | 4.7605 | 103.6 | 267500 | 4.1119 |
583
- | 4.7721 | 103.8 | 268000 | 4.1051 |
584
- | 4.8085 | 103.99 | 268500 | 4.0939 |
585
- | 4.8132 | 104.18 | 269000 | 4.1005 |
586
- | 4.7982 | 104.38 | 269500 | 4.1387 |
587
- | 4.773 | 104.57 | 270000 | 4.1119 |
588
- | 4.7808 | 104.76 | 270500 | 4.0961 |
589
- | 4.7939 | 104.96 | 271000 | 4.0840 |
590
- | 4.7768 | 105.15 | 271500 | 4.1050 |
591
- | 4.7467 | 105.34 | 272000 | 4.1461 |
592
- | 4.7548 | 105.54 | 272500 | 4.0799 |
593
- | 4.741 | 105.73 | 273000 | 4.0630 |
594
- | 4.7791 | 105.93 | 273500 | 4.1192 |
595
- | 4.7811 | 106.12 | 274000 | 4.0974 |
596
- | 4.779 | 106.31 | 274500 | 4.1139 |
597
- | 4.7671 | 106.51 | 275000 | 4.1545 |
598
- | 4.7591 | 106.7 | 275500 | 4.0711 |
599
- | 4.7397 | 106.89 | 276000 | 4.1396 |
600
- | 4.812 | 107.09 | 276500 | 4.1139 |
601
- | 4.7667 | 107.28 | 277000 | 4.1482 |
602
- | 4.7726 | 107.47 | 277500 | 4.0929 |
603
- | 4.7743 | 107.67 | 278000 | 4.1404 |
604
- | 4.8268 | 107.86 | 278500 | 4.0917 |
605
- | 4.7602 | 108.06 | 279000 | 4.0721 |
606
- | 4.7174 | 108.25 | 279500 | 4.0603 |
607
- | 4.7754 | 108.44 | 280000 | 4.0796 |
608
- | 4.7836 | 108.64 | 280500 | 4.0001 |
609
- | 4.7449 | 108.83 | 281000 | 4.0418 |
610
- | 4.7182 | 109.02 | 281500 | 4.0598 |
611
- | 4.7703 | 109.22 | 282000 | 4.0180 |
612
- | 4.753 | 109.41 | 282500 | 4.0955 |
613
- | 4.7676 | 109.6 | 283000 | 4.1175 |
614
- | 4.7524 | 109.8 | 283500 | 4.1301 |
615
- | 4.7649 | 109.99 | 284000 | 4.0187 |
616
- | 4.8173 | 110.19 | 284500 | 4.0858 |
617
- | 4.7429 | 110.38 | 285000 | 4.0677 |
618
- | 4.7291 | 110.57 | 285500 | 4.0544 |
619
- | 4.7649 | 110.77 | 286000 | 4.0417 |
620
- | 4.7774 | 110.96 | 286500 | 4.0597 |
621
- | 4.7408 | 111.15 | 287000 | 4.0819 |
622
- | 4.7158 | 111.35 | 287500 | 4.0791 |
623
- | 4.761 | 111.54 | 288000 | 4.0778 |
624
- | 4.7288 | 111.74 | 288500 | 4.0708 |
625
- | 4.7347 | 111.93 | 289000 | 4.0763 |
626
- | 4.7421 | 112.12 | 289500 | 4.0423 |
627
- | 4.7764 | 112.32 | 290000 | 4.0613 |
628
- | 4.7646 | 112.51 | 290500 | 4.0759 |
629
- | 4.7454 | 112.7 | 291000 | 4.0002 |
630
- | 4.7313 | 112.9 | 291500 | 4.1158 |
631
- | 4.7762 | 113.09 | 292000 | 4.0634 |
632
- | 4.7356 | 113.28 | 292500 | 4.0767 |
633
- | 4.7074 | 113.48 | 293000 | 4.0067 |
634
- | 4.7201 | 113.67 | 293500 | 4.0973 |
635
- | 4.7298 | 113.87 | 294000 | 4.0674 |
636
- | 4.7519 | 114.06 | 294500 | 4.0534 |
637
- | 4.7442 | 114.25 | 295000 | 4.0508 |
638
- | 4.7458 | 114.45 | 295500 | 4.0378 |
639
- | 4.7608 | 114.64 | 296000 | 4.0556 |
640
- | 4.7506 | 114.83 | 296500 | 4.0518 |
641
- | 4.712 | 115.03 | 297000 | 4.0731 |
642
- | 4.7448 | 115.22 | 297500 | 4.1139 |
643
- | 4.741 | 115.41 | 298000 | 4.0649 |
644
- | 4.7355 | 115.61 | 298500 | 4.0266 |
645
- | 4.7166 | 115.8 | 299000 | 4.0326 |
646
- | 4.7299 | 116.0 | 299500 | 4.0534 |
647
- | 4.7281 | 116.19 | 300000 | 4.0798 |
648
- | 4.7644 | 116.38 | 300500 | 4.0643 |
649
- | 4.7187 | 116.58 | 301000 | 4.0643 |
650
- | 4.7208 | 116.77 | 301500 | 3.9957 |
651
- | 4.7362 | 116.96 | 302000 | 4.0475 |
652
- | 4.7898 | 117.16 | 302500 | 4.0549 |
653
- | 4.723 | 117.35 | 303000 | 4.0135 |
654
- | 4.7025 | 117.54 | 303500 | 4.0494 |
655
- | 4.7406 | 117.74 | 304000 | 4.0212 |
656
- | 4.7283 | 117.93 | 304500 | 4.0239 |
657
- | 4.7549 | 118.13 | 305000 | 4.0554 |
658
- | 4.7288 | 118.32 | 305500 | 4.0687 |
659
- | 4.7374 | 118.51 | 306000 | 4.0257 |
660
- | 4.7199 | 118.71 | 306500 | 4.0629 |
661
- | 4.7077 | 118.9 | 307000 | 4.0446 |
662
- | 4.6665 | 119.09 | 307500 | 4.0383 |
663
- | 4.6945 | 119.29 | 308000 | 4.0579 |
664
- | 4.7296 | 119.48 | 308500 | 3.9915 |
665
- | 4.7361 | 119.67 | 309000 | 4.0054 |
666
- | 4.7289 | 119.87 | 309500 | 4.0726 |
667
- | 4.7443 | 120.06 | 310000 | 4.0040 |
668
- | 4.7223 | 120.26 | 310500 | 4.0550 |
669
- | 4.7697 | 120.45 | 311000 | 4.0424 |
670
- | 4.7243 | 120.64 | 311500 | 4.0550 |
671
- | 4.7297 | 120.84 | 312000 | 4.0420 |
672
- | 4.6723 | 121.03 | 312500 | 4.0522 |
673
- | 4.7026 | 121.22 | 313000 | 4.0338 |
674
- | 4.6799 | 121.42 | 313500 | 4.0168 |
675
- | 4.7291 | 121.61 | 314000 | 4.0116 |
676
- | 4.6998 | 121.8 | 314500 | 4.0593 |
677
- | 4.7411 | 122.0 | 315000 | 4.0351 |
678
- | 4.7434 | 122.19 | 315500 | 4.0349 |
679
- | 4.7237 | 122.39 | 316000 | 4.0538 |
680
- | 4.6818 | 122.58 | 316500 | 4.0079 |
681
- | 4.7335 | 122.77 | 317000 | 4.0365 |
682
- | 4.6919 | 122.97 | 317500 | 4.0020 |
683
- | 4.7064 | 123.16 | 318000 | 4.0620 |
684
- | 4.7295 | 123.35 | 318500 | 4.0390 |
685
- | 4.705 | 123.55 | 319000 | 4.0073 |
686
- | 4.7111 | 123.74 | 319500 | 4.0642 |
687
- | 4.7021 | 123.93 | 320000 | 4.0186 |
688
- | 4.6881 | 124.13 | 320500 | 4.0805 |
689
- | 4.7201 | 124.32 | 321000 | 4.0958 |
690
- | 4.7056 | 124.52 | 321500 | 4.0073 |
691
- | 4.7209 | 124.71 | 322000 | 3.9957 |
692
- | 4.6757 | 124.9 | 322500 | 4.0092 |
693
- | 4.6545 | 125.1 | 323000 | 4.0057 |
694
- | 4.7143 | 125.29 | 323500 | 4.0287 |
695
- | 4.6844 | 125.48 | 324000 | 4.0027 |
696
- | 4.6987 | 125.68 | 324500 | 4.0026 |
697
- | 4.7001 | 125.87 | 325000 | 4.0524 |
698
- | 4.7029 | 126.07 | 325500 | 4.0579 |
699
- | 4.714 | 126.26 | 326000 | 4.0051 |
700
- | 4.6849 | 126.45 | 326500 | 3.9886 |
701
- | 4.6877 | 126.65 | 327000 | 4.0584 |
702
- | 4.6733 | 126.84 | 327500 | 4.0629 |
703
- | 4.6593 | 127.03 | 328000 | 4.0008 |
704
- | 4.6452 | 127.23 | 328500 | 3.9834 |
705
- | 4.6958 | 127.42 | 329000 | 4.0001 |
706
- | 4.7036 | 127.61 | 329500 | 4.0228 |
707
- | 4.6909 | 127.81 | 330000 | 4.0069 |
708
- | 4.7246 | 128.0 | 330500 | 4.0433 |
709
- | 4.6876 | 128.2 | 331000 | 4.0111 |
710
- | 4.6801 | 128.39 | 331500 | 4.0272 |
711
- | 4.7007 | 128.58 | 332000 | 4.0325 |
712
- | 4.6843 | 128.78 | 332500 | 3.9804 |
713
- | 4.682 | 128.97 | 333000 | 4.0172 |
714
- | 4.6821 | 129.16 | 333500 | 4.0320 |
715
- | 4.6887 | 129.36 | 334000 | 4.0455 |
716
- | 4.6944 | 129.55 | 334500 | 3.9796 |
717
- | 4.6469 | 129.74 | 335000 | 4.1000 |
718
- | 4.6873 | 129.94 | 335500 | 4.0318 |
719
- | 4.6798 | 130.13 | 336000 | 4.0709 |
720
- | 4.6494 | 130.33 | 336500 | 3.9781 |
721
- | 4.6566 | 130.52 | 337000 | 3.9981 |
722
- | 4.7216 | 130.71 | 337500 | 4.0055 |
723
- | 4.6647 | 130.91 | 338000 | 3.9488 |
724
- | 4.6612 | 131.1 | 338500 | 3.9682 |
725
- | 4.6922 | 131.29 | 339000 | 3.9910 |
726
- | 4.6761 | 131.49 | 339500 | 4.0043 |
727
- | 4.6672 | 131.68 | 340000 | 3.9937 |
728
- | 4.6928 | 131.87 | 340500 | 4.0283 |
729
- | 4.6693 | 132.07 | 341000 | 4.0096 |
730
- | 4.6942 | 132.26 | 341500 | 4.0011 |
731
- | 4.691 | 132.46 | 342000 | 4.0289 |
732
- | 4.6857 | 132.65 | 342500 | 3.9500 |
733
- | 4.6876 | 132.84 | 343000 | 4.0297 |
734
- | 4.6804 | 133.04 | 343500 | 4.0314 |
735
- | 4.6927 | 133.23 | 344000 | 3.9571 |
736
- | 4.6876 | 133.42 | 344500 | 3.9950 |
737
- | 4.7275 | 133.62 | 345000 | 4.0121 |
738
- | 4.681 | 133.81 | 345500 | 4.0388 |
739
- | 4.6817 | 134.0 | 346000 | 3.9965 |
740
- | 4.7165 | 134.2 | 346500 | 3.9891 |
741
- | 4.6755 | 134.39 | 347000 | 3.9934 |
742
- | 4.6567 | 134.59 | 347500 | 4.0267 |
743
- | 4.6557 | 134.78 | 348000 | 4.0044 |
744
- | 4.6978 | 134.97 | 348500 | 4.0021 |
745
- | 4.6646 | 135.17 | 349000 | 4.0186 |
746
- | 4.6609 | 135.36 | 349500 | 4.0095 |
747
- | 4.6877 | 135.55 | 350000 | 3.9507 |
748
- | 4.6848 | 135.75 | 350500 | 3.9543 |
749
- | 4.6776 | 135.94 | 351000 | 3.9614 |
750
- | 4.7205 | 136.13 | 351500 | 4.0096 |
751
- | 4.7035 | 136.33 | 352000 | 3.9779 |
752
- | 4.6469 | 136.52 | 352500 | 3.9835 |
753
- | 4.6518 | 136.72 | 353000 | 4.0331 |
754
- | 4.6754 | 136.91 | 353500 | 3.9843 |
755
- | 4.6737 | 137.1 | 354000 | 4.0009 |
756
- | 4.6342 | 137.3 | 354500 | 3.9644 |
757
- | 4.6999 | 137.49 | 355000 | 3.9772 |
758
- | 4.6403 | 137.68 | 355500 | 3.9567 |
759
- | 4.6629 | 137.88 | 356000 | 4.0033 |
760
- | 4.6712 | 138.07 | 356500 | 3.9792 |
761
- | 4.6321 | 138.26 | 357000 | 3.9938 |
762
- | 4.6873 | 138.46 | 357500 | 4.0331 |
763
- | 4.679 | 138.65 | 358000 | 4.0253 |
764
- | 4.6719 | 138.85 | 358500 | 4.0241 |
765
- | 4.6645 | 139.04 | 359000 | 4.0020 |
766
- | 4.6749 | 139.23 | 359500 | 3.9650 |
767
- | 4.6669 | 139.43 | 360000 | 4.0217 |
768
- | 4.6733 | 139.62 | 360500 | 4.0091 |
769
- | 4.6611 | 139.81 | 361000 | 3.9784 |
770
- | 4.6779 | 140.01 | 361500 | 3.9584 |
771
- | 4.7099 | 140.2 | 362000 | 3.9507 |
772
- | 4.6567 | 140.4 | 362500 | 3.9709 |
773
- | 4.6805 | 140.59 | 363000 | 3.9759 |
774
- | 4.6655 | 140.78 | 363500 | 4.0131 |
775
- | 4.6893 | 140.98 | 364000 | 3.9965 |
776
- | 4.6689 | 141.17 | 364500 | 3.9491 |
777
- | 4.7013 | 141.36 | 365000 | 3.9650 |
778
- | 4.6743 | 141.56 | 365500 | 4.0340 |
779
- | 4.6474 | 141.75 | 366000 | 4.0008 |
780
- | 4.6644 | 141.94 | 366500 | 4.0105 |
781
- | 4.6686 | 142.14 | 367000 | 3.9689 |
782
- | 4.6663 | 142.33 | 367500 | 3.9512 |
783
- | 4.6423 | 142.53 | 368000 | 4.0118 |
784
- | 4.6735 | 142.72 | 368500 | 3.9793 |
785
- | 4.6833 | 142.91 | 369000 | 3.9959 |
786
- | 4.6779 | 143.11 | 369500 | 3.9251 |
787
- | 4.6554 | 143.3 | 370000 | 4.0481 |
788
- | 4.6533 | 143.49 | 370500 | 3.9282 |
789
- | 4.6795 | 143.69 | 371000 | 4.0121 |
790
- | 4.672 | 143.88 | 371500 | 4.0078 |
791
- | 4.6522 | 144.07 | 372000 | 3.9730 |
792
- | 4.6618 | 144.27 | 372500 | 3.9770 |
793
- | 4.6757 | 144.46 | 373000 | 3.9838 |
794
- | 4.6691 | 144.66 | 373500 | 4.0271 |
795
- | 4.6639 | 144.85 | 374000 | 3.9905 |
796
- | 4.6435 | 145.04 | 374500 | 4.0280 |
797
- | 4.6307 | 145.24 | 375000 | 3.9494 |
798
- | 4.6427 | 145.43 | 375500 | 4.0244 |
799
- | 4.6594 | 145.62 | 376000 | 3.9809 |
800
- | 4.6805 | 145.82 | 376500 | 4.0207 |
801
- | 4.6636 | 146.01 | 377000 | 3.9751 |
802
- | 4.633 | 146.2 | 377500 | 3.9674 |
803
- | 4.6735 | 146.4 | 378000 | 3.9990 |
804
- | 4.6615 | 146.59 | 378500 | 4.0001 |
805
- | 4.6876 | 146.79 | 379000 | 4.0017 |
806
- | 4.6822 | 146.98 | 379500 | 3.9348 |
807
- | 4.6302 | 147.17 | 380000 | 3.9466 |
808
- | 4.6629 | 147.37 | 380500 | 3.9830 |
809
- | 4.6714 | 147.56 | 381000 | 3.9540 |
810
- | 4.6619 | 147.75 | 381500 | 4.0009 |
811
- | 4.6428 | 147.95 | 382000 | 3.9482 |
812
- | 4.6435 | 148.14 | 382500 | 3.9680 |
813
- | 4.6693 | 148.33 | 383000 | 3.9358 |
814
- | 4.6397 | 148.53 | 383500 | 3.9589 |
815
- | 4.6486 | 148.72 | 384000 | 3.9680 |
816
- | 4.656 | 148.92 | 384500 | 3.9466 |
817
- | 4.6447 | 149.11 | 385000 | 3.9404 |
818
- | 4.6215 | 149.3 | 385500 | 3.9649 |
819
- | 4.7191 | 149.5 | 386000 | 3.9060 |
820
- | 4.6238 | 149.69 | 386500 | 3.9398 |
821
- | 4.6519 | 149.88 | 387000 | 3.9594 |
822
-
823
-
824
  ### Framework versions
825
 
826
- - Transformers 4.26.1
827
- - Pytorch 1.13.1+cu116
828
- - Datasets 2.10.1
829
  - Tokenizers 0.13.2
 
3
  tags:
4
  - generated_from_trainer
5
  model-index:
6
+ - name: BERiT
7
  results: []
8
  ---
9
 
 
 
10
 
11
+ # BERiT
12
 
13
+ This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on the [Tanakh dataset](https://huggingface.co/datasets/gngpostalsrvc/Tanakh).
14
  It achieves the following results on the evaluation set:
15
+ - Loss: 3.9931
16
 
17
  ## Model description
18
 
19
+ BERiT is a masked-language model for Biblical Hebrew, a low-resource ancient language preserved primarily in the text of the Hebrew Bible. Building on the work of [Sennrich and Zhang (2019)](https://arxiv.org/abs/1905.11901) and [Wodiak (2021)](https://arxiv.org/abs/2110.01938) on low-resource machine translation, it employs a modified version of the encoder block from Wodiak’s Seq2Seq model. Accordingly, BERiT is much smaller than models designed for modern languages like English. It features a single attention block with four attention heads, smaller embedding and feedforward dimensions (256 and 1024), a smaller max input length (128), and an aggressive dropout rate (.5) at both the attention and feedforward layers.
20
 
21
+ The BERiT tokenizer performs character level byte-pair encoding using a 2000 word base vocabulary, which has been enriched with common grammatical morphemes.
22
 
23
+ ## How to Use
24
 
25
+ ```
26
+ from transformers import RobertaModel, RobertaTokenizerFast
27
 
28
+ BERiT_tokenizer = RobertaTokenizerFast.from_pretrained('gngpostalsrvc/BERiT')
29
+ BERiT = RobertaModel.from_pretrained('gngpostalsrvc/BERiT')
30
+ ```
31
 
32
  ## Training procedure
33
 
34
+ BERiT was trained on the Tanakh dataset for 150 epochs using a Tesla T4 GPU. Further training did not yield significant improvements in performance.
35
+
36
  ### Training hyperparameters
37
 
38
  The following hyperparameters were used during training:
 
44
  - lr_scheduler_type: linear
45
  - num_epochs: 150
46
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
47
  ### Framework versions
48
 
49
+ - Transformers 4.24.0
50
+ - Pytorch 1.12.1+cu113
51
+ - Datasets 2.7.0
52
  - Tokenizers 0.13.2