Hugging Face's logo

mikeadimech
/
longformer-qmsum-meeting-summarization

Text2Text Generation
Transformers
PyTorch
led
generated_from_trainer
Inference Endpoints
Model card Files Community
2
mikeadimech commited on
Commit
d379953
•
1 Parent(s): 9211fcd

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +248 -0
README.md ADDED
@@ -0,0 +1,248 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - generated_from_trainer
5
+ metrics:
6
+ - rouge
7
+ model-index:
8
+ - name: longformer-qmsum-meeting-summarization
9
+ results: []
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # longformer-qmsum-meeting-summarization
16
+
17
+ This model is a fine-tuned version of [allenai/led-base-16384](https://huggingface.co/allenai/led-base-16384) on the None dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 4.2055
20
+ - Rouge1: 20.5333
21
+ - Rouge2: 7.6756
22
+ - Rougel: 16.2531
23
+ - Rougelsum: 19.0336
24
+ - Gen Len: 20.0
25
+
26
+ ## Model description
27
+
28
+ More information needed
29
+
30
+ ## Intended uses & limitations
31
+
32
+ More information needed
33
+
34
+ ## Training and evaluation data
35
+
36
+ More information needed
37
+
38
+ ## Training procedure
39
+
40
+ ### Training hyperparameters
41
+
42
+ The following hyperparameters were used during training:
43
+ - learning_rate: 3e-07
44
+ - train_batch_size: 2
45
+ - eval_batch_size: 2
46
+ - seed: 42
47
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
+ - lr_scheduler_type: linear
49
+ - lr_scheduler_warmup_steps: 500
50
+ - num_epochs: 200
51
+ - label_smoothing_factor: 0.1
52
+
53
+ ### Training results
54
+
55
+ | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
56
+ |:-------------:|:------:|:-----:|:---------------:|:-------:|:------:|:-------:|:---------:|:-------:|
57
+ | 5.4071 | 1.09 | 100 | 5.2910 | 6.012 | 0.5556 | 4.936 | 5.6141 | 20.0 |
58
+ | 5.269 | 2.17 | 200 | 5.1446 | 6.7419 | 0.9713 | 5.2774 | 6.3003 | 20.0 |
59
+ | 5.1153 | 3.26 | 300 | 4.9976 | 8.1369 | 1.2365 | 6.391 | 7.5911 | 20.0 |
60
+ | 4.9888 | 4.35 | 400 | 4.8763 | 9.9113 | 1.4239 | 8.0574 | 9.3442 | 20.0 |
61
+ | 4.8687 | 5.43 | 500 | 4.7889 | 10.504 | 1.5638 | 8.1191 | 9.817 | 20.0 |
62
+ | 4.7936 | 6.52 | 600 | 4.7226 | 12.6475 | 2.4733 | 9.968 | 11.541 | 20.0 |
63
+ | 4.713 | 7.61 | 700 | 4.6770 | 15.2998 | 3.6209 | 11.8629 | 14.2323 | 20.0 |
64
+ | 4.6843 | 8.7 | 800 | 4.6428 | 15.8299 | 4.4128 | 12.7301 | 14.8795 | 20.0 |
65
+ | 4.6453 | 9.78 | 900 | 4.6105 | 16.3702 | 4.7356 | 13.1566 | 15.4497 | 20.0 |
66
+ | 4.6212 | 10.87 | 1000 | 4.5849 | 16.9765 | 5.1101 | 13.617 | 15.9401 | 20.0 |
67
+ | 4.5761 | 11.96 | 1100 | 4.5649 | 17.3024 | 5.2494 | 13.79 | 16.3173 | 20.0 |
68
+ | 4.564 | 13.04 | 1200 | 4.5447 | 18.7699 | 6.2331 | 14.8264 | 17.645 | 20.0 |
69
+ | 4.5393 | 14.13 | 1300 | 4.5277 | 19.1495 | 6.6082 | 15.1392 | 18.2546 | 20.0 |
70
+ | 4.5069 | 15.22 | 1400 | 4.5132 | 20.3648 | 7.3895 | 16.018 | 19.1503 | 20.0 |
71
+ | 4.4985 | 16.3 | 1500 | 4.4973 | 20.165 | 7.3477 | 16.1161 | 18.7585 | 20.0 |
72
+ | 4.4476 | 17.39 | 1600 | 4.4859 | 20.4691 | 7.5734 | 16.438 | 19.1045 | 20.0 |
73
+ | 4.4421 | 18.48 | 1700 | 4.4758 | 20.4402 | 7.7674 | 16.3998 | 19.1045 | 20.0 |
74
+ | 4.4554 | 19.57 | 1800 | 4.4648 | 20.5992 | 7.3522 | 16.185 | 19.2869 | 20.0 |
75
+ | 4.4138 | 20.65 | 1900 | 4.4560 | 20.497 | 7.1732 | 16.2177 | 19.0912 | 20.0 |
76
+ | 4.4447 | 21.74 | 2000 | 4.4465 | 21.2936 | 7.8856 | 16.8994 | 19.7994 | 20.0 |
77
+ | 4.3636 | 22.83 | 2100 | 4.4373 | 21.1015 | 7.6466 | 16.787 | 19.6918 | 20.0 |
78
+ | 4.3647 | 23.91 | 2200 | 4.4288 | 21.3408 | 7.8052 | 17.1431 | 20.1456 | 20.0 |
79
+ | 4.3707 | 25.0 | 2300 | 4.4217 | 21.523 | 8.017 | 17.1586 | 20.2724 | 20.0 |
80
+ | 4.3503 | 26.09 | 2400 | 4.4145 | 21.485 | 8.015 | 17.064 | 20.209 | 20.0 |
81
+ | 4.3295 | 27.17 | 2500 | 4.4069 | 21.5167 | 7.6749 | 16.9976 | 20.265 | 20.0 |
82
+ | 4.3444 | 28.26 | 2600 | 4.4004 | 21.748 | 7.8808 | 17.1592 | 20.4054 | 20.0 |
83
+ | 4.3135 | 29.35 | 2700 | 4.3958 | 21.5523 | 7.5449 | 17.2103 | 20.5405 | 20.0 |
84
+ | 4.3028 | 30.43 | 2800 | 4.3880 | 21.3016 | 7.6531 | 17.1515 | 20.3301 | 20.0 |
85
+ | 4.3406 | 31.52 | 2900 | 4.3834 | 21.4169 | 7.5647 | 16.9477 | 20.3379 | 20.0 |
86
+ | 4.286 | 32.61 | 3000 | 4.3760 | 21.4684 | 7.4776 | 17.1018 | 20.5254 | 20.0 |
87
+ | 4.2717 | 33.7 | 3100 | 4.3736 | 21.596 | 7.514 | 17.164 | 20.6272 | 20.0 |
88
+ | 4.285 | 34.78 | 3200 | 4.3666 | 21.3495 | 7.676 | 17.0703 | 20.3182 | 20.0 |
89
+ | 4.2496 | 35.87 | 3300 | 4.3628 | 21.5539 | 7.6574 | 17.1393 | 20.5116 | 20.0 |
90
+ | 4.2618 | 36.96 | 3400 | 4.3591 | 21.08 | 7.6814 | 16.6941 | 20.2386 | 20.0 |
91
+ | 4.255 | 38.04 | 3500 | 4.3522 | 21.1979 | 7.7334 | 16.8281 | 20.3095 | 20.0 |
92
+ | 4.2353 | 39.13 | 3600 | 4.3502 | 21.1162 | 8.0427 | 16.9948 | 20.3903 | 20.0 |
93
+ | 4.2556 | 40.22 | 3700 | 4.3462 | 21.3417 | 7.7851 | 16.6548 | 20.5316 | 20.0 |
94
+ | 4.207 | 41.3 | 3800 | 4.3401 | 21.4329 | 7.948 | 16.944 | 20.5075 | 20.0 |
95
+ | 4.234 | 42.39 | 3900 | 4.3388 | 21.6109 | 8.033 | 16.9375 | 20.6668 | 20.0 |
96
+ | 4.2118 | 43.48 | 4000 | 4.3347 | 21.5051 | 7.9239 | 16.7403 | 20.6123 | 20.0 |
97
+ | 4.1898 | 44.57 | 4100 | 4.3319 | 21.2644 | 7.8222 | 16.7109 | 20.3999 | 20.0 |
98
+ | 4.1951 | 45.65 | 4200 | 4.3265 | 21.3383 | 7.997 | 16.7605 | 20.4542 | 20.0 |
99
+ | 4.1851 | 46.74 | 4300 | 4.3248 | 21.3509 | 7.9038 | 16.9098 | 20.4593 | 20.0 |
100
+ | 4.1674 | 47.83 | 4400 | 4.3223 | 21.3516 | 8.0058 | 17.0061 | 20.4199 | 20.0 |
101
+ | 4.1785 | 48.91 | 4500 | 4.3182 | 21.4118 | 8.0755 | 16.959 | 20.5154 | 20.0 |
102
+ | 4.1599 | 50.0 | 4600 | 4.3175 | 21.2748 | 7.8562 | 16.8107 | 20.3536 | 20.0 |
103
+ | 4.1564 | 51.09 | 4700 | 4.3141 | 21.1811 | 7.8563 | 16.7687 | 20.2242 | 20.0 |
104
+ | 4.1513 | 52.17 | 4800 | 4.3101 | 21.1557 | 7.6616 | 16.8105 | 19.8191 | 20.0 |
105
+ | 4.1234 | 53.26 | 4900 | 4.3083 | 21.0718 | 7.8625 | 16.7849 | 20.0014 | 20.0 |
106
+ | 4.1532 | 54.35 | 5000 | 4.3041 | 21.4241 | 7.984 | 16.6561 | 20.3073 | 20.0 |
107
+ | 4.1371 | 55.43 | 5100 | 4.3035 | 21.259 | 7.6476 | 16.9931 | 20.3421 | 20.0 |
108
+ | 4.1342 | 56.52 | 5200 | 4.3009 | 21.0745 | 7.386 | 16.7976 | 20.1148 | 20.0 |
109
+ | 4.1146 | 57.61 | 5300 | 4.2985 | 21.0796 | 7.6743 | 16.5062 | 19.8702 | 20.0 |
110
+ | 4.0774 | 58.7 | 5400 | 4.2965 | 21.2129 | 7.2871 | 17.0019 | 20.3176 | 20.0 |
111
+ | 4.1726 | 59.78 | 5500 | 4.2930 | 21.159 | 7.4045 | 16.7762 | 19.9886 | 20.0 |
112
+ | 4.0931 | 60.87 | 5600 | 4.2900 | 20.957 | 7.2307 | 16.784 | 19.8402 | 20.0 |
113
+ | 4.0838 | 61.96 | 5700 | 4.2887 | 21.13 | 7.2664 | 16.7837 | 19.951 | 20.0 |
114
+ | 4.0878 | 63.04 | 5800 | 4.2853 | 21.0281 | 7.2664 | 16.6847 | 19.7843 | 20.0 |
115
+ | 4.1067 | 64.13 | 5900 | 4.2848 | 20.941 | 7.2307 | 16.74 | 19.8262 | 20.0 |
116
+ | 4.0743 | 65.22 | 6000 | 4.2817 | 21.1234 | 7.4612 | 16.755 | 20.027 | 20.0 |
117
+ | 4.103 | 66.3 | 6100 | 4.2807 | 21.2852 | 7.4802 | 16.8037 | 20.2316 | 20.0 |
118
+ | 4.0434 | 67.39 | 6200 | 4.2777 | 21.236 | 7.3169 | 16.7967 | 20.0534 | 20.0 |
119
+ | 4.0829 | 68.48 | 6300 | 4.2793 | 20.947 | 7.3164 | 16.8597 | 19.7938 | 20.0 |
120
+ | 4.0619 | 69.57 | 6400 | 4.2736 | 21.4626 | 7.7245 | 16.8395 | 20.2035 | 20.0 |
121
+ | 4.079 | 70.65 | 6500 | 4.2729 | 21.163 | 7.6397 | 16.7826 | 20.0295 | 20.0 |
122
+ | 4.0411 | 71.74 | 6600 | 4.2721 | 20.8673 | 7.3841 | 16.6784 | 19.6854 | 20.0 |
123
+ | 4.046 | 72.83 | 6700 | 4.2697 | 20.9774 | 7.3325 | 16.7779 | 19.761 | 20.0 |
124
+ | 4.0384 | 73.91 | 6800 | 4.2684 | 21.0736 | 7.6569 | 16.7631 | 19.992 | 20.0 |
125
+ | 4.0401 | 75.0 | 6900 | 4.2670 | 21.2708 | 7.8224 | 16.5649 | 20.2364 | 20.0 |
126
+ | 4.0153 | 76.09 | 7000 | 4.2669 | 21.3638 | 7.7586 | 16.765 | 19.9744 | 20.0 |
127
+ | 4.0227 | 77.17 | 7100 | 4.2652 | 21.0611 | 7.709 | 16.3201 | 20.0516 | 20.0 |
128
+ | 4.0264 | 78.26 | 7200 | 4.2634 | 21.3766 | 7.7666 | 16.7508 | 20.0938 | 20.0 |
129
+ | 4.0475 | 79.35 | 7300 | 4.2615 | 21.2356 | 7.5533 | 16.6339 | 19.9254 | 20.0 |
130
+ | 4.0145 | 80.43 | 7400 | 4.2580 | 20.7689 | 7.3386 | 16.287 | 19.7335 | 20.0 |
131
+ | 4.0087 | 81.52 | 7500 | 4.2580 | 20.9816 | 7.343 | 16.4598 | 19.701 | 20.0 |
132
+ | 3.9835 | 82.61 | 7600 | 4.2577 | 21.1001 | 7.5887 | 16.5226 | 19.714 | 20.0 |
133
+ | 4.0029 | 83.7 | 7700 | 4.2562 | 21.1875 | 7.7333 | 16.4799 | 19.9907 | 20.0 |
134
+ | 3.9912 | 84.78 | 7800 | 4.2549 | 20.8265 | 7.3897 | 16.2191 | 19.4398 | 20.0 |
135
+ | 4.008 | 85.87 | 7900 | 4.2541 | 21.4955 | 7.7602 | 16.4989 | 20.1402 | 20.0 |
136
+ | 3.9659 | 86.96 | 8000 | 4.2523 | 21.687 | 7.9463 | 16.5832 | 20.1598 | 20.0 |
137
+ | 3.9923 | 88.04 | 8100 | 4.2505 | 21.4615 | 7.817 | 16.3628 | 19.9159 | 20.0 |
138
+ | 3.9811 | 89.13 | 8200 | 4.2498 | 21.1917 | 7.5813 | 16.3066 | 19.4905 | 20.0 |
139
+ | 3.9819 | 90.22 | 8300 | 4.2488 | 21.239 | 7.4585 | 16.4297 | 19.5213 | 20.0 |
140
+ | 3.9889 | 91.3 | 8400 | 4.2456 | 21.5052 | 7.7994 | 16.3783 | 19.8739 | 20.0 |
141
+ | 3.942 | 92.39 | 8500 | 4.2468 | 21.3482 | 7.7517 | 16.34 | 19.764 | 20.0 |
142
+ | 3.9959 | 93.48 | 8600 | 4.2446 | 21.4615 | 7.817 | 16.3628 | 19.9159 | 20.0 |
143
+ | 3.987 | 94.57 | 8700 | 4.2438 | 21.1265 | 7.6497 | 16.4132 | 19.5981 | 20.0 |
144
+ | 3.9803 | 95.65 | 8800 | 4.2420 | 21.2956 | 7.7796 | 16.3643 | 19.8607 | 20.0 |
145
+ | 3.9415 | 96.74 | 8900 | 4.2410 | 20.8332 | 7.5468 | 16.1678 | 19.316 | 20.0 |
146
+ | 3.97 | 97.83 | 9000 | 4.2407 | 21.4223 | 7.8688 | 16.533 | 19.8081 | 20.0 |
147
+ | 3.9495 | 98.91 | 9100 | 4.2400 | 21.5678 | 7.9698 | 16.5492 | 19.9404 | 20.0 |
148
+ | 3.9489 | 100.0 | 9200 | 4.2391 | 21.3928 | 7.8416 | 16.3595 | 19.7579 | 20.0 |
149
+ | 3.9194 | 101.09 | 9300 | 4.2394 | 21.2216 | 7.8416 | 16.2499 | 19.5661 | 20.0 |
150
+ | 3.966 | 102.17 | 9400 | 4.2372 | 21.2756 | 7.8798 | 16.3124 | 19.6303 | 20.0 |
151
+ | 3.934 | 103.26 | 9500 | 4.2367 | 21.3106 | 7.8585 | 16.3937 | 19.7289 | 20.0 |
152
+ | 3.9316 | 104.35 | 9600 | 4.2349 | 21.3296 | 7.9392 | 16.3574 | 19.8031 | 20.0 |
153
+ | 3.9586 | 105.43 | 9700 | 4.2366 | 21.0662 | 7.771 | 16.2242 | 19.4813 | 20.0 |
154
+ | 3.9189 | 106.52 | 9800 | 4.2338 | 21.1348 | 7.8414 | 16.2757 | 19.7301 | 20.0 |
155
+ | 3.937 | 107.61 | 9900 | 4.2350 | 21.2434 | 7.7611 | 16.4693 | 19.6923 | 20.0 |
156
+ | 3.911 | 108.7 | 10000 | 4.2331 | 21.2697 | 7.8282 | 16.3636 | 19.6627 | 20.0 |
157
+ | 3.8956 | 109.78 | 10100 | 4.2312 | 21.2697 | 7.8117 | 16.3636 | 19.6321 | 20.0 |
158
+ | 3.9396 | 110.87 | 10200 | 4.2303 | 21.0842 | 7.7105 | 16.221 | 19.4378 | 20.0 |
159
+ | 3.9058 | 111.96 | 10300 | 4.2290 | 21.1633 | 7.8117 | 16.3196 | 19.5575 | 20.0 |
160
+ | 3.9198 | 113.04 | 10400 | 4.2278 | 21.1633 | 7.8117 | 16.3196 | 19.5311 | 20.0 |
161
+ | 3.9104 | 114.13 | 10500 | 4.2276 | 21.0784 | 7.6899 | 16.3248 | 19.5625 | 20.0 |
162
+ | 3.915 | 115.22 | 10600 | 4.2282 | 20.9369 | 7.6522 | 16.1615 | 19.4826 | 20.0 |
163
+ | 3.8748 | 116.3 | 10700 | 4.2268 | 20.9369 | 7.6522 | 16.1615 | 19.4826 | 20.0 |
164
+ | 3.9341 | 117.39 | 10800 | 4.2252 | 21.0067 | 7.7263 | 16.3314 | 19.5589 | 20.0 |
165
+ | 3.8713 | 118.48 | 10900 | 4.2253 | 20.7028 | 7.5712 | 16.0398 | 19.2212 | 20.0 |
166
+ | 3.8861 | 119.57 | 11000 | 4.2243 | 20.7075 | 7.6844 | 16.0626 | 19.2959 | 20.0 |
167
+ | 3.8905 | 120.65 | 11100 | 4.2252 | 20.6546 | 7.5642 | 15.9451 | 19.1838 | 20.0 |
168
+ | 3.8682 | 121.74 | 11200 | 4.2238 | 20.8809 | 7.6536 | 16.1667 | 19.4217 | 20.0 |
169
+ | 3.904 | 122.83 | 11300 | 4.2241 | 20.6916 | 7.5324 | 15.9692 | 19.1791 | 20.0 |
170
+ | 3.8577 | 123.91 | 11400 | 4.2231 | 20.9271 | 7.6536 | 16.2314 | 19.4695 | 20.0 |
171
+ | 3.8851 | 125.0 | 11500 | 4.2230 | 20.8097 | 7.6891 | 16.1087 | 19.3872 | 20.0 |
172
+ | 3.8725 | 126.09 | 11600 | 4.2219 | 20.8965 | 7.6891 | 16.197 | 19.4319 | 20.0 |
173
+ | 3.8918 | 127.17 | 11700 | 4.2210 | 20.8203 | 7.6562 | 16.1283 | 19.388 | 20.0 |
174
+ | 3.845 | 128.26 | 11800 | 4.2210 | 20.7633 | 7.6883 | 16.0813 | 19.3537 | 20.0 |
175
+ | 3.8812 | 129.35 | 11900 | 4.2197 | 20.6605 | 7.6351 | 15.9703 | 19.2425 | 20.0 |
176
+ | 3.8734 | 130.43 | 12000 | 4.2208 | 20.6164 | 7.601 | 15.9703 | 19.1967 | 20.0 |
177
+ | 3.8704 | 131.52 | 12100 | 4.2201 | 20.533 | 7.5141 | 15.941 | 19.1898 | 20.0 |
178
+ | 3.8302 | 132.61 | 12200 | 4.2194 | 20.6164 | 7.601 | 15.9703 | 19.1967 | 20.0 |
179
+ | 3.8793 | 133.7 | 12300 | 4.2178 | 20.5427 | 7.5674 | 15.9591 | 19.2078 | 20.0 |
180
+ | 3.8631 | 134.78 | 12400 | 4.2181 | 20.6953 | 7.6549 | 16.0402 | 19.2734 | 20.0 |
181
+ | 3.8565 | 135.87 | 12500 | 4.2173 | 20.6168 | 7.5808 | 16.0402 | 19.2734 | 20.0 |
182
+ | 3.8842 | 136.96 | 12600 | 4.2163 | 20.6525 | 7.5782 | 16.0402 | 19.3124 | 20.0 |
183
+ | 3.8183 | 138.04 | 12700 | 4.2165 | 20.6168 | 7.5808 | 16.0402 | 19.2734 | 20.0 |
184
+ | 3.8482 | 139.13 | 12800 | 4.2155 | 20.6953 | 7.6154 | 16.0402 | 19.2734 | 20.0 |
185
+ | 3.8689 | 140.22 | 12900 | 4.2158 | 20.8264 | 7.7844 | 16.1396 | 19.4834 | 20.0 |
186
+ | 3.8361 | 141.3 | 13000 | 4.2144 | 20.8264 | 7.6986 | 16.2466 | 19.5192 | 20.0 |
187
+ | 3.8336 | 142.39 | 13100 | 4.2148 | 20.7613 | 7.7027 | 16.2516 | 19.4307 | 20.0 |
188
+ | 3.8532 | 143.48 | 13200 | 4.2155 | 20.6905 | 7.6695 | 16.1708 | 19.3584 | 20.0 |
189
+ | 3.8424 | 144.57 | 13300 | 4.2137 | 20.7613 | 7.7027 | 16.2516 | 19.4307 | 20.0 |
190
+ | 3.8781 | 145.65 | 13400 | 4.2128 | 20.6905 | 7.6695 | 16.1708 | 19.3584 | 20.0 |
191
+ | 3.8693 | 146.74 | 13500 | 4.2128 | 20.5395 | 7.4561 | 16.1388 | 19.1866 | 20.0 |
192
+ | 3.8304 | 147.83 | 13600 | 4.2123 | 20.6345 | 7.7324 | 16.1761 | 19.2764 | 20.0 |
193
+ | 3.8434 | 148.91 | 13700 | 4.2123 | 20.7145 | 7.6768 | 16.1729 | 19.3787 | 20.0 |
194
+ | 3.8348 | 150.0 | 13800 | 4.2123 | 20.7859 | 7.7023 | 16.2986 | 19.4932 | 20.0 |
195
+ | 3.8375 | 151.09 | 13900 | 4.2126 | 20.6319 | 7.5676 | 16.325 | 19.2512 | 20.0 |
196
+ | 3.8421 | 152.17 | 14000 | 4.2120 | 20.6665 | 7.5619 | 16.3257 | 19.2911 | 20.0 |
197
+ | 3.831 | 153.26 | 14100 | 4.2110 | 20.609 | 7.4912 | 16.2881 | 19.2953 | 20.0 |
198
+ | 3.8172 | 154.35 | 14200 | 4.2112 | 20.7352 | 7.6588 | 16.2115 | 19.3408 | 20.0 |
199
+ | 3.7853 | 155.43 | 14300 | 4.2107 | 20.6635 | 7.5987 | 16.2131 | 19.2667 | 20.0 |
200
+ | 3.8274 | 156.52 | 14400 | 4.2109 | 20.7352 | 7.7559 | 16.3035 | 19.3408 | 20.0 |
201
+ | 3.8362 | 157.61 | 14500 | 4.2099 | 20.7559 | 7.6865 | 16.325 | 19.4191 | 20.0 |
202
+ | 3.8561 | 158.7 | 14600 | 4.2098 | 20.6225 | 7.6943 | 16.3448 | 19.1425 | 20.0 |
203
+ | 3.7832 | 159.78 | 14700 | 4.2098 | 20.6307 | 7.6684 | 16.2469 | 19.269 | 20.0 |
204
+ | 3.8409 | 160.87 | 14800 | 4.2092 | 20.683 | 7.7924 | 16.2986 | 19.2414 | 20.0 |
205
+ | 3.821 | 161.96 | 14900 | 4.2092 | 20.5235 | 7.6721 | 16.2191 | 18.9879 | 20.0 |
206
+ | 3.8343 | 163.04 | 15000 | 4.2089 | 20.5235 | 7.6721 | 16.2191 | 18.9879 | 20.0 |
207
+ | 3.8279 | 164.13 | 15100 | 4.2087 | 20.5304 | 7.5448 | 16.2106 | 19.0909 | 20.0 |
208
+ | 3.7874 | 165.22 | 15200 | 4.2083 | 20.6319 | 7.6145 | 16.3035 | 19.2294 | 20.0 |
209
+ | 3.8316 | 166.3 | 15300 | 4.2076 | 20.5759 | 7.6145 | 16.2528 | 19.1508 | 20.0 |
210
+ | 3.7817 | 167.39 | 15400 | 4.2084 | 20.4845 | 7.5473 | 16.2067 | 19.0683 | 20.0 |
211
+ | 3.8338 | 168.48 | 15500 | 4.2075 | 20.5375 | 7.614 | 16.2509 | 19.1047 | 20.0 |
212
+ | 3.8515 | 169.57 | 15600 | 4.2069 | 20.4845 | 7.5473 | 16.2067 | 19.0683 | 20.0 |
213
+ | 3.7895 | 170.65 | 15700 | 4.2074 | 20.4845 | 7.5473 | 16.2067 | 19.0683 | 20.0 |
214
+ | 3.8129 | 171.74 | 15800 | 4.2076 | 20.4845 | 7.5473 | 16.2067 | 19.0683 | 20.0 |
215
+ | 3.8582 | 172.83 | 15900 | 4.2073 | 20.4845 | 7.5473 | 16.2067 | 19.0683 | 20.0 |
216
+ | 3.7716 | 173.91 | 16000 | 4.2073 | 20.5333 | 7.6756 | 16.2531 | 19.0336 | 20.0 |
217
+ | 3.8142 | 175.0 | 16100 | 4.2069 | 20.5333 | 7.6756 | 16.2531 | 19.0336 | 20.0 |
218
+ | 3.8186 | 176.09 | 16200 | 4.2068 | 20.5333 | 7.6756 | 16.2531 | 19.0336 | 20.0 |
219
+ | 3.8323 | 177.17 | 16300 | 4.2065 | 20.5333 | 7.6281 | 16.2531 | 19.0336 | 20.0 |
220
+ | 3.774 | 178.26 | 16400 | 4.2064 | 20.5724 | 7.677 | 16.2545 | 19.0747 | 20.0 |
221
+ | 3.8123 | 179.35 | 16500 | 4.2062 | 20.5333 | 7.6281 | 16.2531 | 19.0336 | 20.0 |
222
+ | 3.7914 | 180.43 | 16600 | 4.2066 | 20.5333 | 7.6281 | 16.2531 | 19.0336 | 20.0 |
223
+ | 3.7988 | 181.52 | 16700 | 4.2063 | 20.5724 | 7.6287 | 16.2545 | 19.0747 | 20.0 |
224
+ | 3.8331 | 182.61 | 16800 | 4.2059 | 20.6225 | 7.7265 | 16.3103 | 19.1036 | 20.0 |
225
+ | 3.8125 | 183.7 | 16900 | 4.2061 | 20.494 | 7.5897 | 16.2303 | 18.9697 | 20.0 |
226
+ | 3.8069 | 184.78 | 17000 | 4.2059 | 20.5333 | 7.6756 | 16.2531 | 19.0336 | 20.0 |
227
+ | 3.7933 | 185.87 | 17100 | 4.2058 | 20.5333 | 7.6281 | 16.2531 | 19.0336 | 20.0 |
228
+ | 3.807 | 186.96 | 17200 | 4.2058 | 20.5333 | 7.6756 | 16.2531 | 19.0336 | 20.0 |
229
+ | 3.8 | 188.04 | 17300 | 4.2055 | 20.5333 | 7.6756 | 16.2531 | 19.0336 | 20.0 |
230
+ | 3.776 | 189.13 | 17400 | 4.2057 | 20.5333 | 7.6756 | 16.2531 | 19.0336 | 20.0 |
231
+ | 3.7976 | 190.22 | 17500 | 4.2057 | 20.5333 | 7.6756 | 16.2531 | 19.0336 | 20.0 |
232
+ | 3.8293 | 191.3 | 17600 | 4.2057 | 20.5333 | 7.6756 | 16.2531 | 19.0336 | 20.0 |
233
+ | 3.7807 | 192.39 | 17700 | 4.2057 | 20.5333 | 7.6756 | 16.2531 | 19.0336 | 20.0 |
234
+ | 3.8246 | 193.48 | 17800 | 4.2055 | 20.5333 | 7.6756 | 16.2531 | 19.0336 | 20.0 |
235
+ | 3.7719 | 194.57 | 17900 | 4.2055 | 20.5333 | 7.6756 | 16.2531 | 19.0336 | 20.0 |
236
+ | 3.8055 | 195.65 | 18000 | 4.2055 | 20.5333 | 7.6756 | 16.2531 | 19.0336 | 20.0 |
237
+ | 3.7803 | 196.74 | 18100 | 4.2055 | 20.5333 | 7.6756 | 16.2531 | 19.0336 | 20.0 |
238
+ | 3.8287 | 197.83 | 18200 | 4.2055 | 20.5333 | 7.6756 | 16.2531 | 19.0336 | 20.0 |
239
+ | 3.8066 | 198.91 | 18300 | 4.2055 | 20.5333 | 7.6756 | 16.2531 | 19.0336 | 20.0 |
240
+ | 3.8011 | 200.0 | 18400 | 4.2055 | 20.5333 | 7.6756 | 16.2531 | 19.0336 | 20.0 |
241
+
242
+
243
+ ### Framework versions
244
+
245
+ - Transformers 4.18.0
246
+ - Pytorch 1.11.0+cu113
247
+ - Datasets 2.1.0
248
+ - Tokenizers 0.12.1