update model card README.md
Browse files
README.md
ADDED
@@ -0,0 +1,255 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
tags:
|
4 |
+
- generated_from_trainer
|
5 |
+
model-index:
|
6 |
+
- name: finetuned-marktextepoch-n200
|
7 |
+
results: []
|
8 |
+
---
|
9 |
+
|
10 |
+
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
11 |
+
should probably proofread and complete it, then remove this comment. -->
|
12 |
+
|
13 |
+
# finetuned-marktextepoch-n200
|
14 |
+
|
15 |
+
This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on the None dataset.
|
16 |
+
It achieves the following results on the evaluation set:
|
17 |
+
- Loss: 2.0880
|
18 |
+
|
19 |
+
## Model description
|
20 |
+
|
21 |
+
More information needed
|
22 |
+
|
23 |
+
## Intended uses & limitations
|
24 |
+
|
25 |
+
More information needed
|
26 |
+
|
27 |
+
## Training and evaluation data
|
28 |
+
|
29 |
+
More information needed
|
30 |
+
|
31 |
+
## Training procedure
|
32 |
+
|
33 |
+
### Training hyperparameters
|
34 |
+
|
35 |
+
The following hyperparameters were used during training:
|
36 |
+
- learning_rate: 2e-05
|
37 |
+
- train_batch_size: 8
|
38 |
+
- eval_batch_size: 8
|
39 |
+
- seed: 42
|
40 |
+
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
41 |
+
- lr_scheduler_type: linear
|
42 |
+
- num_epochs: 200
|
43 |
+
|
44 |
+
### Training results
|
45 |
+
|
46 |
+
| Training Loss | Epoch | Step | Validation Loss |
|
47 |
+
|:-------------:|:-----:|:------:|:---------------:|
|
48 |
+
| 2.5742 | 1.0 | 1606 | 2.4071 |
|
49 |
+
| 2.4441 | 2.0 | 3212 | 2.2715 |
|
50 |
+
| 2.3699 | 3.0 | 4818 | 2.2896 |
|
51 |
+
| 2.3074 | 4.0 | 6424 | 2.2295 |
|
52 |
+
| 2.2667 | 5.0 | 8030 | 2.2147 |
|
53 |
+
| 2.2376 | 6.0 | 9636 | 2.1886 |
|
54 |
+
| 2.2161 | 7.0 | 11242 | 2.1816 |
|
55 |
+
| 2.1611 | 8.0 | 12848 | 2.1690 |
|
56 |
+
| 2.1418 | 9.0 | 14454 | 2.1541 |
|
57 |
+
| 2.1198 | 10.0 | 16060 | 2.1355 |
|
58 |
+
| 2.1033 | 11.0 | 17666 | 2.1132 |
|
59 |
+
| 2.0738 | 12.0 | 19272 | 2.1441 |
|
60 |
+
| 2.0581 | 13.0 | 20878 | 2.1068 |
|
61 |
+
| 2.0555 | 14.0 | 22484 | 2.1035 |
|
62 |
+
| 2.0375 | 15.0 | 24090 | 2.1000 |
|
63 |
+
| 2.0071 | 16.0 | 25696 | 2.1084 |
|
64 |
+
| 1.9942 | 17.0 | 27302 | 2.0711 |
|
65 |
+
| 1.9554 | 18.0 | 28908 | 2.0978 |
|
66 |
+
| 1.9469 | 19.0 | 30514 | 2.0705 |
|
67 |
+
| 1.9414 | 20.0 | 32120 | 2.0597 |
|
68 |
+
| 1.9331 | 21.0 | 33726 | 2.0782 |
|
69 |
+
| 1.9132 | 22.0 | 35332 | 2.0622 |
|
70 |
+
| 1.9003 | 23.0 | 36938 | 2.0426 |
|
71 |
+
| 1.9019 | 24.0 | 38544 | 2.0562 |
|
72 |
+
| 1.8733 | 25.0 | 40150 | 2.0419 |
|
73 |
+
| 1.8556 | 26.0 | 41756 | 2.0572 |
|
74 |
+
| 1.8399 | 27.0 | 43362 | 2.0453 |
|
75 |
+
| 1.8332 | 28.0 | 44968 | 2.0517 |
|
76 |
+
| 1.8296 | 29.0 | 46574 | 2.0580 |
|
77 |
+
| 1.788 | 30.0 | 48180 | 2.0454 |
|
78 |
+
| 1.7944 | 31.0 | 49786 | 2.0193 |
|
79 |
+
| 1.7716 | 32.0 | 51392 | 2.0595 |
|
80 |
+
| 1.7799 | 33.0 | 52998 | 2.0379 |
|
81 |
+
| 1.7633 | 34.0 | 54604 | 2.0392 |
|
82 |
+
| 1.7477 | 35.0 | 56210 | 2.0122 |
|
83 |
+
| 1.7407 | 36.0 | 57816 | 2.0293 |
|
84 |
+
| 1.7163 | 37.0 | 59422 | 2.0339 |
|
85 |
+
| 1.72 | 38.0 | 61028 | 1.9987 |
|
86 |
+
| 1.729 | 39.0 | 62634 | 2.0135 |
|
87 |
+
| 1.709 | 40.0 | 64240 | 2.0455 |
|
88 |
+
| 1.7019 | 41.0 | 65846 | 2.0206 |
|
89 |
+
| 1.6958 | 42.0 | 67452 | 2.0408 |
|
90 |
+
| 1.6789 | 43.0 | 69058 | 2.0470 |
|
91 |
+
| 1.6907 | 44.0 | 70664 | 2.0280 |
|
92 |
+
| 1.6531 | 45.0 | 72270 | 2.0514 |
|
93 |
+
| 1.6563 | 46.0 | 73876 | 2.0428 |
|
94 |
+
| 1.6364 | 47.0 | 75482 | 2.0305 |
|
95 |
+
| 1.6534 | 48.0 | 77088 | 2.0200 |
|
96 |
+
| 1.6312 | 49.0 | 78694 | 2.0444 |
|
97 |
+
| 1.6092 | 50.0 | 80300 | 2.0154 |
|
98 |
+
| 1.5998 | 51.0 | 81906 | 2.0249 |
|
99 |
+
| 1.5808 | 52.0 | 83512 | 2.0235 |
|
100 |
+
| 1.5945 | 53.0 | 85118 | 2.0286 |
|
101 |
+
| 1.6004 | 54.0 | 86724 | 2.0288 |
|
102 |
+
| 1.5802 | 55.0 | 88330 | 2.0346 |
|
103 |
+
| 1.5665 | 56.0 | 89936 | 2.0120 |
|
104 |
+
| 1.5723 | 57.0 | 91542 | 2.0257 |
|
105 |
+
| 1.5553 | 58.0 | 93148 | 2.0146 |
|
106 |
+
| 1.5445 | 59.0 | 94754 | 2.0333 |
|
107 |
+
| 1.5669 | 60.0 | 96360 | 2.0325 |
|
108 |
+
| 1.5318 | 61.0 | 97966 | 2.0250 |
|
109 |
+
| 1.5117 | 62.0 | 99572 | 2.0343 |
|
110 |
+
| 1.5248 | 63.0 | 101178 | 2.0183 |
|
111 |
+
| 1.5149 | 64.0 | 102784 | 2.0422 |
|
112 |
+
| 1.5087 | 65.0 | 104390 | 2.0236 |
|
113 |
+
| 1.5087 | 66.0 | 105996 | 2.0275 |
|
114 |
+
| 1.4938 | 67.0 | 107602 | 2.0384 |
|
115 |
+
| 1.5008 | 68.0 | 109208 | 2.0167 |
|
116 |
+
| 1.4871 | 69.0 | 110814 | 2.0456 |
|
117 |
+
| 1.4931 | 70.0 | 112420 | 2.0083 |
|
118 |
+
| 1.467 | 71.0 | 114026 | 2.0313 |
|
119 |
+
| 1.4519 | 72.0 | 115632 | 2.0254 |
|
120 |
+
| 1.448 | 73.0 | 117238 | 2.0289 |
|
121 |
+
| 1.4475 | 74.0 | 118844 | 2.0051 |
|
122 |
+
| 1.4522 | 75.0 | 120450 | 2.0378 |
|
123 |
+
| 1.4508 | 76.0 | 122056 | 2.0612 |
|
124 |
+
| 1.4428 | 77.0 | 123662 | 2.0479 |
|
125 |
+
| 1.4496 | 78.0 | 125268 | 2.0082 |
|
126 |
+
| 1.4305 | 79.0 | 126874 | 2.0376 |
|
127 |
+
| 1.4072 | 80.0 | 128480 | 2.0294 |
|
128 |
+
| 1.4148 | 81.0 | 130086 | 2.0565 |
|
129 |
+
| 1.4078 | 82.0 | 131692 | 2.0309 |
|
130 |
+
| 1.3931 | 83.0 | 133298 | 2.0371 |
|
131 |
+
| 1.4038 | 84.0 | 134904 | 2.0318 |
|
132 |
+
| 1.3893 | 85.0 | 136510 | 2.0413 |
|
133 |
+
| 1.3862 | 86.0 | 138116 | 2.0503 |
|
134 |
+
| 1.3782 | 87.0 | 139722 | 2.0182 |
|
135 |
+
| 1.3757 | 88.0 | 141328 | 2.0253 |
|
136 |
+
| 1.3879 | 89.0 | 142934 | 2.0357 |
|
137 |
+
| 1.3768 | 90.0 | 144540 | 2.0405 |
|
138 |
+
| 1.3494 | 91.0 | 146146 | 2.0495 |
|
139 |
+
| 1.3492 | 92.0 | 147752 | 2.0586 |
|
140 |
+
| 1.353 | 93.0 | 149358 | 2.0779 |
|
141 |
+
| 1.3397 | 94.0 | 150964 | 2.0564 |
|
142 |
+
| 1.3486 | 95.0 | 152570 | 2.0459 |
|
143 |
+
| 1.3262 | 96.0 | 154176 | 2.0692 |
|
144 |
+
| 1.349 | 97.0 | 155782 | 2.0765 |
|
145 |
+
| 1.3228 | 98.0 | 157388 | 2.0443 |
|
146 |
+
| 1.3291 | 99.0 | 158994 | 2.0617 |
|
147 |
+
| 1.3211 | 100.0 | 160600 | 2.0552 |
|
148 |
+
| 1.3344 | 101.0 | 162206 | 2.0626 |
|
149 |
+
| 1.307 | 102.0 | 163812 | 2.0492 |
|
150 |
+
| 1.2968 | 103.0 | 165418 | 2.0461 |
|
151 |
+
| 1.2919 | 104.0 | 167024 | 2.0725 |
|
152 |
+
| 1.3004 | 105.0 | 168630 | 2.0424 |
|
153 |
+
| 1.303 | 106.0 | 170236 | 2.0484 |
|
154 |
+
| 1.2847 | 107.0 | 171842 | 2.0083 |
|
155 |
+
| 1.2861 | 108.0 | 173448 | 2.0491 |
|
156 |
+
| 1.2763 | 109.0 | 175054 | 2.0505 |
|
157 |
+
| 1.2852 | 110.0 | 176660 | 2.0691 |
|
158 |
+
| 1.2611 | 111.0 | 178266 | 2.0711 |
|
159 |
+
| 1.2739 | 112.0 | 179872 | 2.0730 |
|
160 |
+
| 1.278 | 113.0 | 181478 | 2.0551 |
|
161 |
+
| 1.2581 | 114.0 | 183084 | 2.0554 |
|
162 |
+
| 1.2532 | 115.0 | 184690 | 2.0513 |
|
163 |
+
| 1.2322 | 116.0 | 186296 | 2.0292 |
|
164 |
+
| 1.2774 | 117.0 | 187902 | 2.0409 |
|
165 |
+
| 1.242 | 118.0 | 189508 | 2.0517 |
|
166 |
+
| 1.2476 | 119.0 | 191114 | 2.0612 |
|
167 |
+
| 1.2314 | 120.0 | 192720 | 2.0795 |
|
168 |
+
| 1.2379 | 121.0 | 194326 | 2.0679 |
|
169 |
+
| 1.2291 | 122.0 | 195932 | 2.0472 |
|
170 |
+
| 1.2515 | 123.0 | 197538 | 2.0829 |
|
171 |
+
| 1.2467 | 124.0 | 199144 | 2.0662 |
|
172 |
+
| 1.2437 | 125.0 | 200750 | 2.0962 |
|
173 |
+
| 1.2373 | 126.0 | 202356 | 2.0692 |
|
174 |
+
| 1.2099 | 127.0 | 203962 | 2.0688 |
|
175 |
+
| 1.1911 | 128.0 | 205568 | 2.0803 |
|
176 |
+
| 1.2311 | 129.0 | 207174 | 2.0765 |
|
177 |
+
| 1.2095 | 130.0 | 208780 | 2.0697 |
|
178 |
+
| 1.2093 | 131.0 | 210386 | 2.0507 |
|
179 |
+
| 1.2065 | 132.0 | 211992 | 2.0658 |
|
180 |
+
| 1.1964 | 133.0 | 213598 | 2.0542 |
|
181 |
+
| 1.2085 | 134.0 | 215204 | 2.0722 |
|
182 |
+
| 1.1871 | 135.0 | 216810 | 2.0806 |
|
183 |
+
| 1.1863 | 136.0 | 218416 | 2.0691 |
|
184 |
+
| 1.1763 | 137.0 | 220022 | 2.0869 |
|
185 |
+
| 1.1816 | 138.0 | 221628 | 2.0780 |
|
186 |
+
| 1.1854 | 139.0 | 223234 | 2.0462 |
|
187 |
+
| 1.1902 | 140.0 | 224840 | 2.0880 |
|
188 |
+
| 1.1762 | 141.0 | 226446 | 2.0682 |
|
189 |
+
| 1.1551 | 142.0 | 228052 | 2.0837 |
|
190 |
+
| 1.171 | 143.0 | 229658 | 2.1028 |
|
191 |
+
| 1.1571 | 144.0 | 231264 | 2.0726 |
|
192 |
+
| 1.1627 | 145.0 | 232870 | 2.0863 |
|
193 |
+
| 1.1537 | 146.0 | 234476 | 2.0857 |
|
194 |
+
| 1.1695 | 147.0 | 236082 | 2.0620 |
|
195 |
+
| 1.1477 | 148.0 | 237688 | 2.0817 |
|
196 |
+
| 1.1592 | 149.0 | 239294 | 2.0705 |
|
197 |
+
| 1.1478 | 150.0 | 240900 | 2.0841 |
|
198 |
+
| 1.1398 | 151.0 | 242506 | 2.0886 |
|
199 |
+
| 1.144 | 152.0 | 244112 | 2.0673 |
|
200 |
+
| 1.1646 | 153.0 | 245718 | 2.0620 |
|
201 |
+
| 1.12 | 154.0 | 247324 | 2.0821 |
|
202 |
+
| 1.1419 | 155.0 | 248930 | 2.0632 |
|
203 |
+
| 1.1436 | 156.0 | 250536 | 2.0817 |
|
204 |
+
| 1.1365 | 157.0 | 252142 | 2.0663 |
|
205 |
+
| 1.1318 | 158.0 | 253748 | 2.0796 |
|
206 |
+
| 1.1219 | 159.0 | 255354 | 2.0825 |
|
207 |
+
| 1.1306 | 160.0 | 256960 | 2.0837 |
|
208 |
+
| 1.1295 | 161.0 | 258566 | 2.0564 |
|
209 |
+
| 1.1261 | 162.0 | 260172 | 2.0722 |
|
210 |
+
| 1.1273 | 163.0 | 261778 | 2.1058 |
|
211 |
+
| 1.1143 | 164.0 | 263384 | 2.0963 |
|
212 |
+
| 1.1276 | 165.0 | 264990 | 2.0948 |
|
213 |
+
| 1.1238 | 166.0 | 266596 | 2.0695 |
|
214 |
+
| 1.1222 | 167.0 | 268202 | 2.0801 |
|
215 |
+
| 1.1145 | 168.0 | 269808 | 2.0768 |
|
216 |
+
| 1.1093 | 169.0 | 271414 | 2.0664 |
|
217 |
+
| 1.1141 | 170.0 | 273020 | 2.0903 |
|
218 |
+
| 1.0936 | 171.0 | 274626 | 2.1012 |
|
219 |
+
| 1.1048 | 172.0 | 276232 | 2.1033 |
|
220 |
+
| 1.0991 | 173.0 | 277838 | 2.0761 |
|
221 |
+
| 1.1164 | 174.0 | 279444 | 2.0689 |
|
222 |
+
| 1.0935 | 175.0 | 281050 | 2.0754 |
|
223 |
+
| 1.1032 | 176.0 | 282656 | 2.0810 |
|
224 |
+
| 1.1124 | 177.0 | 284262 | 2.0790 |
|
225 |
+
| 1.1107 | 178.0 | 285868 | 2.0762 |
|
226 |
+
| 1.085 | 179.0 | 287474 | 2.0697 |
|
227 |
+
| 1.093 | 180.0 | 289080 | 2.0856 |
|
228 |
+
| 1.1034 | 181.0 | 290686 | 2.0734 |
|
229 |
+
| 1.0983 | 182.0 | 292292 | 2.0837 |
|
230 |
+
| 1.0972 | 183.0 | 293898 | 2.1063 |
|
231 |
+
| 1.0909 | 184.0 | 295504 | 2.0873 |
|
232 |
+
| 1.0805 | 185.0 | 297110 | 2.0888 |
|
233 |
+
| 1.0893 | 186.0 | 298716 | 2.0498 |
|
234 |
+
| 1.096 | 187.0 | 300322 | 2.0906 |
|
235 |
+
| 1.0781 | 188.0 | 301928 | 2.0905 |
|
236 |
+
| 1.0981 | 189.0 | 303534 | 2.0767 |
|
237 |
+
| 1.093 | 190.0 | 305140 | 2.0695 |
|
238 |
+
| 1.0814 | 191.0 | 306746 | 2.0763 |
|
239 |
+
| 1.0862 | 192.0 | 308352 | 2.0890 |
|
240 |
+
| 1.0833 | 193.0 | 309958 | 2.1026 |
|
241 |
+
| 1.0806 | 194.0 | 311564 | 2.0978 |
|
242 |
+
| 1.0834 | 195.0 | 313170 | 2.1004 |
|
243 |
+
| 1.0807 | 196.0 | 314776 | 2.0953 |
|
244 |
+
| 1.0827 | 197.0 | 316382 | 2.1129 |
|
245 |
+
| 1.0826 | 198.0 | 317988 | 2.1069 |
|
246 |
+
| 1.0796 | 199.0 | 319594 | 2.0867 |
|
247 |
+
| 1.0881 | 200.0 | 321200 | 2.0880 |
|
248 |
+
|
249 |
+
|
250 |
+
### Framework versions
|
251 |
+
|
252 |
+
- Transformers 4.21.1
|
253 |
+
- Pytorch 1.12.0+cu113
|
254 |
+
- Datasets 2.4.0
|
255 |
+
- Tokenizers 0.12.1
|