--- license: apache-2.0 tags: - automatic-speech-recognition - gary109/AI_Light_Dance - generated_from_trainer model-index: - name: ai-light-dance_singing3_ft_wav2vec2-large-xlsr-53-v2 results: [] --- # ai-light-dance_singing3_ft_wav2vec2-large-xlsr-53-v2 This model is a fine-tuned version of [gary109/ai-light-dance_singing3_ft_wav2vec2-large-xlsr-53-v2](https://huggingface.co/gary109/ai-light-dance_singing3_ft_wav2vec2-large-xlsr-53-v2) on the GARY109/AI_LIGHT_DANCE - ONSET-SINGING3 dataset. It achieves the following results on the evaluation set: - Loss: 0.4660 - Wer: 0.2274 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 4e-05 - train_batch_size: 8 - eval_batch_size: 8 - seed: 42 - gradient_accumulation_steps: 8 - total_train_batch_size: 64 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - lr_scheduler_warmup_steps: 1000 - num_epochs: 500.0 - mixed_precision_training: Native AMP ### Training results | Training Loss | Epoch | Step | Validation Loss | Wer | |:-------------:|:-----:|:-----:|:---------------:|:------:| | 0.4528 | 1.0 | 72 | 0.4860 | 0.2236 | | 0.4403 | 2.0 | 144 | 0.4814 | 0.2222 | | 0.4309 | 3.0 | 216 | 0.4952 | 0.2238 | | 0.4193 | 4.0 | 288 | 0.4864 | 0.2190 | | 0.427 | 5.0 | 360 | 0.5071 | 0.2261 | | 0.4342 | 6.0 | 432 | 0.4932 | 0.2218 | | 0.4205 | 7.0 | 504 | 0.4869 | 0.2222 | | 0.437 | 8.0 | 576 | 0.5125 | 0.2224 | | 0.4316 | 9.0 | 648 | 0.5095 | 0.2285 | | 0.4383 | 10.0 | 720 | 0.5398 | 0.2346 | | 0.4431 | 11.0 | 792 | 0.5177 | 0.2259 | | 0.4555 | 12.0 | 864 | 0.5246 | 0.2335 | | 0.4488 | 13.0 | 936 | 0.5248 | 0.2277 | | 0.4449 | 14.0 | 1008 | 0.5196 | 0.2254 | | 0.4629 | 15.0 | 1080 | 0.4933 | 0.2297 | | 0.4565 | 16.0 | 1152 | 0.5469 | 0.2297 | | 0.4396 | 17.0 | 1224 | 0.5356 | 0.2439 | | 0.4452 | 18.0 | 1296 | 0.5298 | 0.2510 | | 0.4449 | 19.0 | 1368 | 0.5024 | 0.2291 | | 0.4437 | 20.0 | 1440 | 0.5288 | 0.2374 | | 0.4572 | 21.0 | 1512 | 0.4954 | 0.2344 | | 0.4633 | 22.0 | 1584 | 0.5043 | 0.2361 | | 0.4486 | 23.0 | 1656 | 0.5076 | 0.2250 | | 0.4386 | 24.0 | 1728 | 0.5564 | 0.2492 | | 0.4478 | 25.0 | 1800 | 0.5299 | 0.2236 | | 0.4654 | 26.0 | 1872 | 0.5076 | 0.2276 | | 0.453 | 27.0 | 1944 | 0.5666 | 0.2395 | | 0.4474 | 28.0 | 2016 | 0.5026 | 0.2254 | | 0.4465 | 29.0 | 2088 | 0.5216 | 0.2352 | | 0.4689 | 30.0 | 2160 | 0.5293 | 0.2370 | | 0.4467 | 31.0 | 2232 | 0.4856 | 0.2303 | | 0.4379 | 32.0 | 2304 | 0.5089 | 0.2240 | | 0.4302 | 33.0 | 2376 | 0.4958 | 0.2173 | | 0.4417 | 34.0 | 2448 | 0.5392 | 0.2337 | | 0.4458 | 35.0 | 2520 | 0.5229 | 0.2416 | | 0.4415 | 36.0 | 2592 | 0.5280 | 0.2344 | | 0.4621 | 37.0 | 2664 | 0.5362 | 0.2459 | | 0.44 | 38.0 | 2736 | 0.5071 | 0.2285 | | 0.4288 | 39.0 | 2808 | 0.5264 | 0.2313 | | 0.4594 | 40.0 | 2880 | 0.5238 | 0.2306 | | 0.4428 | 41.0 | 2952 | 0.5375 | 0.2286 | | 0.4233 | 42.0 | 3024 | 0.5214 | 0.2254 | | 0.4462 | 43.0 | 3096 | 0.5145 | 0.2450 | | 0.4282 | 44.0 | 3168 | 0.5519 | 0.2254 | | 0.454 | 45.0 | 3240 | 0.5401 | 0.2382 | | 0.4494 | 46.0 | 3312 | 0.5117 | 0.2229 | | 0.4292 | 47.0 | 3384 | 0.5295 | 0.2352 | | 0.4321 | 48.0 | 3456 | 0.4953 | 0.2299 | | 0.4145 | 49.0 | 3528 | 0.5233 | 0.2297 | | 0.4278 | 50.0 | 3600 | 0.5151 | 0.2258 | | 0.4395 | 51.0 | 3672 | 0.4660 | 0.2274 | | 0.4298 | 52.0 | 3744 | 0.5083 | 0.2409 | | 0.4279 | 53.0 | 3816 | 0.4855 | 0.2219 | | 0.4164 | 54.0 | 3888 | 0.5074 | 0.2267 | | 0.4386 | 55.0 | 3960 | 0.5016 | 0.2241 | | 0.4497 | 56.0 | 4032 | 0.5378 | 0.2305 | | 0.4267 | 57.0 | 4104 | 0.5199 | 0.2344 | | 0.4083 | 58.0 | 4176 | 0.5134 | 0.2249 | | 0.4163 | 59.0 | 4248 | 0.4975 | 0.2316 | | 0.4271 | 60.0 | 4320 | 0.5298 | 0.2291 | | 0.43 | 61.0 | 4392 | 0.4991 | 0.2289 | | 0.437 | 62.0 | 4464 | 0.5154 | 0.2298 | | 0.415 | 63.0 | 4536 | 0.5167 | 0.2224 | | 0.4308 | 64.0 | 4608 | 0.5324 | 0.2287 | | 0.4247 | 65.0 | 4680 | 0.5396 | 0.2224 | | 0.4076 | 66.0 | 4752 | 0.5354 | 0.2274 | | 0.4196 | 67.0 | 4824 | 0.5523 | 0.2225 | | 0.4216 | 68.0 | 4896 | 0.5180 | 0.2166 | | 0.4132 | 69.0 | 4968 | 0.5111 | 0.2212 | | 0.4306 | 70.0 | 5040 | 0.5534 | 0.2416 | | 0.4327 | 71.0 | 5112 | 0.5628 | 0.2473 | | 0.4301 | 72.0 | 5184 | 0.5216 | 0.2252 | | 0.4328 | 73.0 | 5256 | 0.5154 | 0.2250 | | 0.4021 | 74.0 | 5328 | 0.5686 | 0.2245 | | 0.465 | 75.0 | 5400 | 0.5236 | 0.2419 | | 0.416 | 76.0 | 5472 | 0.5614 | 0.2365 | | 0.4337 | 77.0 | 5544 | 0.5275 | 0.2302 | | 0.4157 | 78.0 | 5616 | 0.5126 | 0.2293 | | 0.4143 | 79.0 | 5688 | 0.5260 | 0.2376 | | 0.4174 | 80.0 | 5760 | 0.5254 | 0.2317 | | 0.4174 | 81.0 | 5832 | 0.4971 | 0.2191 | | 0.4082 | 82.0 | 5904 | 0.5245 | 0.2320 | | 0.4263 | 83.0 | 5976 | 0.5692 | 0.2401 | | 0.4164 | 84.0 | 6048 | 0.5209 | 0.2312 | | 0.4144 | 85.0 | 6120 | 0.5164 | 0.2340 | | 0.4189 | 86.0 | 6192 | 0.5545 | 0.2459 | | 0.4311 | 87.0 | 6264 | 0.5349 | 0.2477 | | 0.4224 | 88.0 | 6336 | 0.5093 | 0.2375 | | 0.4069 | 89.0 | 6408 | 0.5664 | 0.2443 | | 0.4082 | 90.0 | 6480 | 0.5426 | 0.2391 | | 0.411 | 91.0 | 6552 | 0.5219 | 0.2339 | | 0.4085 | 92.0 | 6624 | 0.5468 | 0.2360 | | 0.4012 | 93.0 | 6696 | 0.5514 | 0.2526 | | 0.3863 | 94.0 | 6768 | 0.5440 | 0.2344 | | 0.4098 | 95.0 | 6840 | 0.5355 | 0.2362 | | 0.4136 | 96.0 | 6912 | 0.5400 | 0.2409 | | 0.4066 | 97.0 | 6984 | 0.5117 | 0.2313 | | 0.4131 | 98.0 | 7056 | 0.5365 | 0.2375 | | 0.3852 | 99.0 | 7128 | 0.5172 | 0.2326 | | 0.3935 | 100.0 | 7200 | 0.5085 | 0.2296 | | 0.4093 | 101.0 | 7272 | 0.5650 | 0.2525 | | 0.3938 | 102.0 | 7344 | 0.5246 | 0.2324 | | 0.4016 | 103.0 | 7416 | 0.5084 | 0.2292 | | 0.412 | 104.0 | 7488 | 0.5308 | 0.2211 | | 0.3903 | 105.0 | 7560 | 0.5047 | 0.2201 | | 0.396 | 106.0 | 7632 | 0.5302 | 0.2223 | | 0.3891 | 107.0 | 7704 | 0.5367 | 0.2222 | | 0.3886 | 108.0 | 7776 | 0.5459 | 0.2328 | | 0.379 | 109.0 | 7848 | 0.5486 | 0.2340 | | 0.4009 | 110.0 | 7920 | 0.5080 | 0.2186 | | 0.3967 | 111.0 | 7992 | 0.5389 | 0.2193 | | 0.3988 | 112.0 | 8064 | 0.5488 | 0.2281 | | 0.3952 | 113.0 | 8136 | 0.5409 | 0.2294 | | 0.3884 | 114.0 | 8208 | 0.5304 | 0.2326 | | 0.3939 | 115.0 | 8280 | 0.5542 | 0.2211 | | 0.3927 | 116.0 | 8352 | 0.5676 | 0.2259 | | 0.3944 | 117.0 | 8424 | 0.5221 | 0.2210 | | 0.3941 | 118.0 | 8496 | 0.5474 | 0.2247 | | 0.3912 | 119.0 | 8568 | 0.5451 | 0.2185 | | 0.4209 | 120.0 | 8640 | 0.5282 | 0.2282 | | 0.3882 | 121.0 | 8712 | 0.5263 | 0.2184 | | 0.3891 | 122.0 | 8784 | 0.5301 | 0.2194 | | 0.3964 | 123.0 | 8856 | 0.5608 | 0.2220 | | 0.3918 | 124.0 | 8928 | 0.5233 | 0.2230 | | 0.3834 | 125.0 | 9000 | 0.5286 | 0.2195 | | 0.3952 | 126.0 | 9072 | 0.5410 | 0.2258 | | 0.3812 | 127.0 | 9144 | 0.5183 | 0.2207 | | 0.3904 | 128.0 | 9216 | 0.5393 | 0.2244 | | 0.3797 | 129.0 | 9288 | 0.5213 | 0.2226 | | 0.3802 | 130.0 | 9360 | 0.5470 | 0.2207 | | 0.4097 | 131.0 | 9432 | 0.5206 | 0.2254 | | 0.3771 | 132.0 | 9504 | 0.5075 | 0.2182 | | 0.3732 | 133.0 | 9576 | 0.5153 | 0.2255 | | 0.3727 | 134.0 | 9648 | 0.5107 | 0.2212 | | 0.3751 | 135.0 | 9720 | 0.5147 | 0.2259 | | 0.3858 | 136.0 | 9792 | 0.5519 | 0.2220 | | 0.3889 | 137.0 | 9864 | 0.5606 | 0.2222 | | 0.3916 | 138.0 | 9936 | 0.5401 | 0.2252 | | 0.3775 | 139.0 | 10008 | 0.5393 | 0.2269 | | 0.3963 | 140.0 | 10080 | 0.5504 | 0.2322 | | 0.3941 | 141.0 | 10152 | 0.5338 | 0.2342 | | 0.3801 | 142.0 | 10224 | 0.5115 | 0.2276 | | 0.3809 | 143.0 | 10296 | 0.4966 | 0.2261 | | 0.3751 | 144.0 | 10368 | 0.4910 | 0.2240 | | 0.3827 | 145.0 | 10440 | 0.5291 | 0.2204 | | 0.384 | 146.0 | 10512 | 0.5702 | 0.2278 | | 0.3728 | 147.0 | 10584 | 0.5340 | 0.2283 | | 0.3963 | 148.0 | 10656 | 0.5513 | 0.2286 | | 0.3802 | 149.0 | 10728 | 0.5424 | 0.2264 | | 0.3874 | 150.0 | 10800 | 0.5219 | 0.2200 | | 0.3743 | 151.0 | 10872 | 0.5147 | 0.2161 | | 0.3931 | 152.0 | 10944 | 0.5318 | 0.2324 | | 0.3755 | 153.0 | 11016 | 0.5457 | 0.2252 | | 0.3744 | 154.0 | 11088 | 0.5448 | 0.2260 | | 0.3799 | 155.0 | 11160 | 0.5276 | 0.2171 | | 0.3953 | 156.0 | 11232 | 0.5546 | 0.2263 | | 0.3716 | 157.0 | 11304 | 0.5110 | 0.2246 | | 0.3725 | 158.0 | 11376 | 0.5385 | 0.2193 | | 0.364 | 159.0 | 11448 | 0.5114 | 0.2216 | | 0.3666 | 160.0 | 11520 | 0.5584 | 0.2248 | | 0.3797 | 161.0 | 11592 | 0.5313 | 0.2238 | | 0.3704 | 162.0 | 11664 | 0.5542 | 0.2281 | | 0.362 | 163.0 | 11736 | 0.5674 | 0.2241 | | 0.3551 | 164.0 | 11808 | 0.5484 | 0.2210 | | 0.3765 | 165.0 | 11880 | 0.5380 | 0.2252 | | 0.3821 | 166.0 | 11952 | 0.5441 | 0.2267 | | 0.3608 | 167.0 | 12024 | 0.4983 | 0.2186 | | 0.3595 | 168.0 | 12096 | 0.5065 | 0.2166 | | 0.3652 | 169.0 | 12168 | 0.5211 | 0.2150 | | 0.3635 | 170.0 | 12240 | 0.5341 | 0.2164 | | 0.3614 | 171.0 | 12312 | 0.5059 | 0.2183 | | 0.3522 | 172.0 | 12384 | 0.5530 | 0.2199 | | 0.3522 | 173.0 | 12456 | 0.5581 | 0.2142 | | 0.3503 | 174.0 | 12528 | 0.5394 | 0.2211 | | 0.3583 | 175.0 | 12600 | 0.5460 | 0.2252 | | 0.3562 | 176.0 | 12672 | 0.5199 | 0.2223 | | 0.351 | 177.0 | 12744 | 0.5248 | 0.2146 | | 0.3667 | 178.0 | 12816 | 0.5400 | 0.2169 | | 0.3407 | 179.0 | 12888 | 0.5349 | 0.2095 | | 0.3563 | 180.0 | 12960 | 0.5259 | 0.2116 | | 0.3656 | 181.0 | 13032 | 0.5130 | 0.2115 | | 0.3714 | 182.0 | 13104 | 0.5071 | 0.2151 | | 0.3565 | 183.0 | 13176 | 0.5419 | 0.2205 | | 0.3521 | 184.0 | 13248 | 0.5380 | 0.2250 | | 0.3605 | 185.0 | 13320 | 0.5437 | 0.2230 | | 0.3508 | 186.0 | 13392 | 0.5391 | 0.2225 | | 0.3746 | 187.0 | 13464 | 0.5426 | 0.2274 | | 0.3478 | 188.0 | 13536 | 0.5824 | 0.2247 | | 0.3475 | 189.0 | 13608 | 0.5233 | 0.2103 | | 0.3676 | 190.0 | 13680 | 0.5214 | 0.2122 | | 0.3579 | 191.0 | 13752 | 0.5267 | 0.2124 | | 0.3563 | 192.0 | 13824 | 0.5343 | 0.2132 | | 0.3531 | 193.0 | 13896 | 0.5205 | 0.2205 | | 0.3424 | 194.0 | 13968 | 0.5196 | 0.2196 | | 0.3617 | 195.0 | 14040 | 0.5302 | 0.2222 | | 0.3461 | 196.0 | 14112 | 0.5366 | 0.2204 | | 0.3524 | 197.0 | 14184 | 0.5383 | 0.2212 | | 0.3354 | 198.0 | 14256 | 0.5279 | 0.2166 | | 0.3501 | 199.0 | 14328 | 0.5235 | 0.2165 | | 0.3384 | 200.0 | 14400 | 0.5330 | 0.2152 | | 0.3565 | 201.0 | 14472 | 0.5262 | 0.2211 | | 0.3385 | 202.0 | 14544 | 0.5404 | 0.2173 | | 0.3533 | 203.0 | 14616 | 0.5465 | 0.2209 | | 0.3503 | 204.0 | 14688 | 0.5243 | 0.2223 | | 0.3529 | 205.0 | 14760 | 0.5611 | 0.2276 | | 0.3555 | 206.0 | 14832 | 0.5437 | 0.2209 | | 0.3548 | 207.0 | 14904 | 0.5401 | 0.2249 | | 0.3417 | 208.0 | 14976 | 0.5643 | 0.2304 | | 0.3271 | 209.0 | 15048 | 0.5356 | 0.2183 | | 0.344 | 210.0 | 15120 | 0.5300 | 0.2173 | | 0.3416 | 211.0 | 15192 | 0.5343 | 0.2169 | | 0.3393 | 212.0 | 15264 | 0.5677 | 0.2206 | | 0.3356 | 213.0 | 15336 | 0.5514 | 0.2194 | | 0.3344 | 214.0 | 15408 | 0.5527 | 0.2198 | | 0.3303 | 215.0 | 15480 | 0.5590 | 0.2146 | | 0.3503 | 216.0 | 15552 | 0.5681 | 0.2242 | | 0.339 | 217.0 | 15624 | 0.5318 | 0.2186 | | 0.3361 | 218.0 | 15696 | 0.5369 | 0.2247 | | 0.334 | 219.0 | 15768 | 0.5173 | 0.2152 | | 0.3222 | 220.0 | 15840 | 0.5965 | 0.2236 | | 0.3247 | 221.0 | 15912 | 0.5543 | 0.2165 | | 0.338 | 222.0 | 15984 | 0.5836 | 0.2178 | | 0.3112 | 223.0 | 16056 | 0.5573 | 0.2171 | | 0.3203 | 224.0 | 16128 | 0.5830 | 0.2196 | | 0.3294 | 225.0 | 16200 | 0.5815 | 0.2198 | | 0.3392 | 226.0 | 16272 | 0.5641 | 0.2163 | | 0.3332 | 227.0 | 16344 | 0.5770 | 0.2204 | | 0.3365 | 228.0 | 16416 | 0.5843 | 0.2181 | | 0.3186 | 229.0 | 16488 | 0.5835 | 0.2231 | | 0.3329 | 230.0 | 16560 | 0.5867 | 0.2220 | | 0.3257 | 231.0 | 16632 | 0.6081 | 0.2196 | | 0.3183 | 232.0 | 16704 | 0.5944 | 0.2220 | | 0.3315 | 233.0 | 16776 | 0.6060 | 0.2222 | | 0.3269 | 234.0 | 16848 | 0.6268 | 0.2260 | | 0.3191 | 235.0 | 16920 | 0.5796 | 0.2183 | | 0.3395 | 236.0 | 16992 | 0.6140 | 0.2257 | | 0.3186 | 237.0 | 17064 | 0.6302 | 0.2277 | | 0.3264 | 238.0 | 17136 | 0.5752 | 0.2194 | | 0.3181 | 239.0 | 17208 | 0.6066 | 0.2196 | | 0.3201 | 240.0 | 17280 | 0.6013 | 0.2223 | | 0.3242 | 241.0 | 17352 | 0.5960 | 0.2207 | | 0.3194 | 242.0 | 17424 | 0.6093 | 0.2311 | | 0.3203 | 243.0 | 17496 | 0.6047 | 0.2281 | | 0.3173 | 244.0 | 17568 | 0.6260 | 0.2285 | | 0.3118 | 245.0 | 17640 | 0.5961 | 0.2243 | | 0.3172 | 246.0 | 17712 | 0.6315 | 0.2242 | | 0.332 | 247.0 | 17784 | 0.6413 | 0.2250 | | 0.3315 | 248.0 | 17856 | 0.6260 | 0.2290 | | 0.3222 | 249.0 | 17928 | 0.6175 | 0.2307 | | 0.3291 | 250.0 | 18000 | 0.6005 | 0.2283 | | 0.3321 | 251.0 | 18072 | 0.6299 | 0.2311 | | 0.3338 | 252.0 | 18144 | 0.6011 | 0.2310 | | 0.3274 | 253.0 | 18216 | 0.5662 | 0.2203 | | 0.3148 | 254.0 | 18288 | 0.6139 | 0.2344 | | 0.3295 | 255.0 | 18360 | 0.6183 | 0.2461 | | 0.3169 | 256.0 | 18432 | 0.6136 | 0.2283 | | 0.3431 | 257.0 | 18504 | 0.6445 | 0.2446 | | 0.3209 | 258.0 | 18576 | 0.6124 | 0.2437 | | 0.3405 | 259.0 | 18648 | 0.6210 | 0.2446 | | 0.3317 | 260.0 | 18720 | 0.6088 | 0.2350 | | 0.3265 | 261.0 | 18792 | 0.5792 | 0.2324 | | 0.332 | 262.0 | 18864 | 0.6326 | 0.2427 | | 0.3179 | 263.0 | 18936 | 0.6174 | 0.2256 | | 0.3119 | 264.0 | 19008 | 0.6338 | 0.2277 | | 0.3223 | 265.0 | 19080 | 0.6236 | 0.2213 | | 0.315 | 266.0 | 19152 | 0.6025 | 0.2263 | | 0.3214 | 267.0 | 19224 | 0.5881 | 0.2243 | | 0.3184 | 268.0 | 19296 | 0.5942 | 0.2225 | | 0.3083 | 269.0 | 19368 | 0.5836 | 0.2209 | | 0.3098 | 270.0 | 19440 | 0.5844 | 0.2192 | | 0.2992 | 271.0 | 19512 | 0.5972 | 0.2218 | | 0.3118 | 272.0 | 19584 | 0.5768 | 0.2220 | | 0.3112 | 273.0 | 19656 | 0.5926 | 0.2167 | | 0.2994 | 274.0 | 19728 | 0.6056 | 0.2227 | | 0.3041 | 275.0 | 19800 | 0.5793 | 0.2245 | | 0.3072 | 276.0 | 19872 | 0.6188 | 0.2277 | | 0.3042 | 277.0 | 19944 | 0.5931 | 0.2251 | | 0.3107 | 278.0 | 20016 | 0.6205 | 0.2216 | | 0.3077 | 279.0 | 20088 | 0.6001 | 0.2209 | | 0.2903 | 280.0 | 20160 | 0.6002 | 0.2141 | | 0.3124 | 281.0 | 20232 | 0.5782 | 0.2168 | | 0.3043 | 282.0 | 20304 | 0.6105 | 0.2187 | | 0.3007 | 283.0 | 20376 | 0.6105 | 0.2213 | | 0.3023 | 284.0 | 20448 | 0.6011 | 0.2232 | | 0.3062 | 285.0 | 20520 | 0.5967 | 0.2195 | | 0.3093 | 286.0 | 20592 | 0.6571 | 0.2258 | | 0.3041 | 287.0 | 20664 | 0.5956 | 0.2213 | | 0.3083 | 288.0 | 20736 | 0.5904 | 0.2253 | | 0.3037 | 289.0 | 20808 | 0.6096 | 0.2295 | | 0.3064 | 290.0 | 20880 | 0.5958 | 0.2232 | | 0.3136 | 291.0 | 20952 | 0.6134 | 0.2250 | | 0.3042 | 292.0 | 21024 | 0.6144 | 0.2189 | | 0.2967 | 293.0 | 21096 | 0.6086 | 0.2282 | | 0.2952 | 294.0 | 21168 | 0.6178 | 0.2285 | | 0.301 | 295.0 | 21240 | 0.5924 | 0.2189 | | 0.3058 | 296.0 | 21312 | 0.6032 | 0.2193 | | 0.2983 | 297.0 | 21384 | 0.5823 | 0.2183 | | 0.2793 | 298.0 | 21456 | 0.5930 | 0.2195 | | 0.2936 | 299.0 | 21528 | 0.6166 | 0.2215 | | 0.298 | 300.0 | 21600 | 0.5864 | 0.2159 | | 0.2949 | 301.0 | 21672 | 0.6049 | 0.2160 | | 0.2948 | 302.0 | 21744 | 0.5745 | 0.2173 | | 0.2809 | 303.0 | 21816 | 0.5699 | 0.2173 | | 0.2854 | 304.0 | 21888 | 0.5894 | 0.2243 | | 0.2908 | 305.0 | 21960 | 0.6123 | 0.2229 | | 0.2948 | 306.0 | 22032 | 0.5966 | 0.2162 | | 0.2997 | 307.0 | 22104 | 0.6030 | 0.2180 | | 0.2906 | 308.0 | 22176 | 0.5920 | 0.2185 | | 0.2778 | 309.0 | 22248 | 0.5913 | 0.2121 | | 0.281 | 310.0 | 22320 | 0.6020 | 0.2121 | | 0.2852 | 311.0 | 22392 | 0.5814 | 0.2170 | | 0.278 | 312.0 | 22464 | 0.5931 | 0.2151 | | 0.2743 | 313.0 | 22536 | 0.6073 | 0.2179 | | 0.2757 | 314.0 | 22608 | 0.6174 | 0.2153 | | 0.2907 | 315.0 | 22680 | 0.5729 | 0.2171 | | 0.2801 | 316.0 | 22752 | 0.6014 | 0.2214 | | 0.2908 | 317.0 | 22824 | 0.6098 | 0.2130 | | 0.2824 | 318.0 | 22896 | 0.5942 | 0.2191 | | 0.2799 | 319.0 | 22968 | 0.6374 | 0.2230 | | 0.2725 | 320.0 | 23040 | 0.6424 | 0.2206 | | 0.2821 | 321.0 | 23112 | 0.6465 | 0.2203 | | 0.2795 | 322.0 | 23184 | 0.6163 | 0.2182 | | 0.2764 | 323.0 | 23256 | 0.6257 | 0.2209 | | 0.2739 | 324.0 | 23328 | 0.6374 | 0.2194 | | 0.2712 | 325.0 | 23400 | 0.6228 | 0.2166 | | 0.275 | 326.0 | 23472 | 0.6394 | 0.2214 | | 0.275 | 327.0 | 23544 | 0.6359 | 0.2213 | | 0.2702 | 328.0 | 23616 | 0.6430 | 0.2207 | | 0.2676 | 329.0 | 23688 | 0.6321 | 0.2145 | | 0.2735 | 330.0 | 23760 | 0.6583 | 0.2168 | | 0.2815 | 331.0 | 23832 | 0.6368 | 0.2178 | | 0.2823 | 332.0 | 23904 | 0.6373 | 0.2197 | | 0.2885 | 333.0 | 23976 | 0.6352 | 0.2200 | | 0.2751 | 334.0 | 24048 | 0.6431 | 0.2159 | | 0.2717 | 335.0 | 24120 | 0.6339 | 0.2213 | | 0.286 | 336.0 | 24192 | 0.6566 | 0.2245 | | 0.2678 | 337.0 | 24264 | 0.6443 | 0.2194 | | 0.2692 | 338.0 | 24336 | 0.6352 | 0.2225 | | 0.273 | 339.0 | 24408 | 0.6497 | 0.2187 | | 0.2686 | 340.0 | 24480 | 0.6788 | 0.2214 | | 0.2699 | 341.0 | 24552 | 0.6615 | 0.2198 | | 0.2636 | 342.0 | 24624 | 0.6765 | 0.2196 | | 0.2545 | 343.0 | 24696 | 0.6737 | 0.2202 | | 0.2612 | 344.0 | 24768 | 0.6891 | 0.2240 | | 0.2705 | 345.0 | 24840 | 0.6550 | 0.2204 | | 0.2658 | 346.0 | 24912 | 0.6591 | 0.2200 | | 0.2701 | 347.0 | 24984 | 0.6222 | 0.2216 | | 0.2743 | 348.0 | 25056 | 0.6263 | 0.2186 | | 0.2657 | 349.0 | 25128 | 0.6509 | 0.2186 | | 0.2635 | 350.0 | 25200 | 0.6570 | 0.2207 | | 0.2601 | 351.0 | 25272 | 0.6496 | 0.2155 | | 0.2695 | 352.0 | 25344 | 0.6305 | 0.2169 | | 0.2586 | 353.0 | 25416 | 0.6269 | 0.2223 | | 0.2529 | 354.0 | 25488 | 0.6418 | 0.2204 | | 0.2739 | 355.0 | 25560 | 0.6472 | 0.2175 | | 0.2738 | 356.0 | 25632 | 0.6416 | 0.2187 | | 0.2775 | 357.0 | 25704 | 0.6470 | 0.2208 | | 0.2775 | 358.0 | 25776 | 0.6483 | 0.2201 | | 0.2622 | 359.0 | 25848 | 0.6233 | 0.2164 | | 0.2727 | 360.0 | 25920 | 0.6438 | 0.2178 | | 0.275 | 361.0 | 25992 | 0.6459 | 0.2222 | | 0.2688 | 362.0 | 26064 | 0.6329 | 0.2188 | | 0.2658 | 363.0 | 26136 | 0.6482 | 0.2207 | | 0.2693 | 364.0 | 26208 | 0.6337 | 0.2194 | | 0.2599 | 365.0 | 26280 | 0.6458 | 0.2189 | | 0.2683 | 366.0 | 26352 | 0.6483 | 0.2213 | | 0.2665 | 367.0 | 26424 | 0.6576 | 0.2203 | | 0.2529 | 368.0 | 26496 | 0.6629 | 0.2200 | | 0.2536 | 369.0 | 26568 | 0.6665 | 0.2208 | | 0.2562 | 370.0 | 26640 | 0.6545 | 0.2171 | | 0.2713 | 371.0 | 26712 | 0.6433 | 0.2231 | | 0.2545 | 372.0 | 26784 | 0.6330 | 0.2202 | | 0.2513 | 373.0 | 26856 | 0.6474 | 0.2154 | | 0.2564 | 374.0 | 26928 | 0.6519 | 0.2191 | | 0.266 | 375.0 | 27000 | 0.6577 | 0.2199 | | 0.2623 | 376.0 | 27072 | 0.6508 | 0.2187 | | 0.2666 | 377.0 | 27144 | 0.6358 | 0.2171 | | 0.2503 | 378.0 | 27216 | 0.6515 | 0.2195 | | 0.252 | 379.0 | 27288 | 0.6479 | 0.2221 | | 0.2558 | 380.0 | 27360 | 0.6344 | 0.2203 | | 0.2673 | 381.0 | 27432 | 0.6717 | 0.2196 | | 0.2615 | 382.0 | 27504 | 0.6393 | 0.2178 | | 0.2603 | 383.0 | 27576 | 0.6375 | 0.2167 | | 0.2522 | 384.0 | 27648 | 0.6381 | 0.2195 | | 0.2532 | 385.0 | 27720 | 0.6566 | 0.2209 | | 0.2544 | 386.0 | 27792 | 0.6640 | 0.2231 | | 0.2529 | 387.0 | 27864 | 0.6531 | 0.2207 | | 0.2578 | 388.0 | 27936 | 0.6915 | 0.2202 | | 0.2517 | 389.0 | 28008 | 0.6902 | 0.2238 | | 0.2453 | 390.0 | 28080 | 0.6727 | 0.2249 | | 0.2634 | 391.0 | 28152 | 0.6667 | 0.2235 | | 0.2515 | 392.0 | 28224 | 0.6554 | 0.2212 | | 0.249 | 393.0 | 28296 | 0.6672 | 0.2214 | | 0.2524 | 394.0 | 28368 | 0.6693 | 0.2164 | | 0.2529 | 395.0 | 28440 | 0.6572 | 0.2186 | | 0.256 | 396.0 | 28512 | 0.6420 | 0.2171 | | 0.2498 | 397.0 | 28584 | 0.6712 | 0.2168 | | 0.2565 | 398.0 | 28656 | 0.6890 | 0.2175 | | 0.2477 | 399.0 | 28728 | 0.6905 | 0.2185 | | 0.2486 | 400.0 | 28800 | 0.7010 | 0.2191 | | 0.259 | 401.0 | 28872 | 0.6983 | 0.2169 | | 0.2555 | 402.0 | 28944 | 0.6877 | 0.2189 | | 0.2579 | 403.0 | 29016 | 0.6864 | 0.2188 | | 0.2421 | 404.0 | 29088 | 0.6603 | 0.2175 | | 0.2531 | 405.0 | 29160 | 0.6882 | 0.2223 | | 0.254 | 406.0 | 29232 | 0.6813 | 0.2209 | | 0.2517 | 407.0 | 29304 | 0.6707 | 0.2205 | | 0.2521 | 408.0 | 29376 | 0.6835 | 0.2234 | | 0.2494 | 409.0 | 29448 | 0.6896 | 0.2216 | | 0.2516 | 410.0 | 29520 | 0.6760 | 0.2218 | | 0.2605 | 411.0 | 29592 | 0.7055 | 0.2207 | | 0.2514 | 412.0 | 29664 | 0.6707 | 0.2232 | | 0.242 | 413.0 | 29736 | 0.6853 | 0.2183 | | 0.2505 | 414.0 | 29808 | 0.6869 | 0.2232 | | 0.2398 | 415.0 | 29880 | 0.6732 | 0.2228 | | 0.2549 | 416.0 | 29952 | 0.6559 | 0.2222 | | 0.2496 | 417.0 | 30024 | 0.6675 | 0.2232 | | 0.2538 | 418.0 | 30096 | 0.6695 | 0.2240 | | 0.246 | 419.0 | 30168 | 0.6917 | 0.2268 | | 0.2462 | 420.0 | 30240 | 0.6842 | 0.2288 | | 0.2527 | 421.0 | 30312 | 0.6628 | 0.2207 | | 0.2469 | 422.0 | 30384 | 0.6683 | 0.2225 | | 0.2493 | 423.0 | 30456 | 0.6632 | 0.2189 | | 0.239 | 424.0 | 30528 | 0.6848 | 0.2198 | | 0.2373 | 425.0 | 30600 | 0.6834 | 0.2223 | | 0.245 | 426.0 | 30672 | 0.6902 | 0.2251 | | 0.239 | 427.0 | 30744 | 0.6917 | 0.2223 | | 0.2441 | 428.0 | 30816 | 0.6859 | 0.2232 | | 0.2306 | 429.0 | 30888 | 0.6844 | 0.2208 | | 0.2373 | 430.0 | 30960 | 0.6740 | 0.2185 | | 0.2495 | 431.0 | 31032 | 0.6823 | 0.2214 | | 0.2457 | 432.0 | 31104 | 0.6686 | 0.2219 | | 0.2474 | 433.0 | 31176 | 0.6856 | 0.2215 | | 0.2434 | 434.0 | 31248 | 0.6876 | 0.2199 | | 0.2377 | 435.0 | 31320 | 0.6827 | 0.2234 | | 0.2566 | 436.0 | 31392 | 0.6920 | 0.2213 | | 0.2384 | 437.0 | 31464 | 0.6734 | 0.2234 | | 0.2477 | 438.0 | 31536 | 0.6992 | 0.2242 | | 0.2347 | 439.0 | 31608 | 0.6837 | 0.2217 | | 0.2345 | 440.0 | 31680 | 0.6852 | 0.2222 | | 0.2457 | 441.0 | 31752 | 0.6891 | 0.2230 | | 0.2512 | 442.0 | 31824 | 0.6976 | 0.2263 | | 0.25 | 443.0 | 31896 | 0.6889 | 0.2232 | | 0.2341 | 444.0 | 31968 | 0.6841 | 0.2266 | | 0.252 | 445.0 | 32040 | 0.6981 | 0.2249 | | 0.2486 | 446.0 | 32112 | 0.6958 | 0.2281 | | 0.2402 | 447.0 | 32184 | 0.6826 | 0.2249 | | 0.2477 | 448.0 | 32256 | 0.6867 | 0.2247 | | 0.2304 | 449.0 | 32328 | 0.7022 | 0.2243 | | 0.2376 | 450.0 | 32400 | 0.6948 | 0.2222 | | 0.2388 | 451.0 | 32472 | 0.6771 | 0.2221 | | 0.2544 | 452.0 | 32544 | 0.6841 | 0.2249 | | 0.2428 | 453.0 | 32616 | 0.6886 | 0.2220 | | 0.2438 | 454.0 | 32688 | 0.6903 | 0.2214 | | 0.2463 | 455.0 | 32760 | 0.6781 | 0.2219 | | 0.2355 | 456.0 | 32832 | 0.6784 | 0.2198 | | 0.237 | 457.0 | 32904 | 0.6849 | 0.2231 | | 0.2381 | 458.0 | 32976 | 0.6892 | 0.2220 | | 0.23 | 459.0 | 33048 | 0.6782 | 0.2207 | | 0.2359 | 460.0 | 33120 | 0.6789 | 0.2238 | | 0.2382 | 461.0 | 33192 | 0.6829 | 0.2236 | | 0.2438 | 462.0 | 33264 | 0.6928 | 0.2236 | | 0.233 | 463.0 | 33336 | 0.6860 | 0.2216 | | 0.2358 | 464.0 | 33408 | 0.6857 | 0.2236 | | 0.2226 | 465.0 | 33480 | 0.6818 | 0.2202 | | 0.2478 | 466.0 | 33552 | 0.6801 | 0.2222 | | 0.2274 | 467.0 | 33624 | 0.6797 | 0.2203 | | 0.2339 | 468.0 | 33696 | 0.6915 | 0.2224 | | 0.2259 | 469.0 | 33768 | 0.6919 | 0.2220 | | 0.2327 | 470.0 | 33840 | 0.6877 | 0.2225 | | 0.2341 | 471.0 | 33912 | 0.6892 | 0.2235 | | 0.2502 | 472.0 | 33984 | 0.6900 | 0.2227 | | 0.234 | 473.0 | 34056 | 0.6839 | 0.2242 | | 0.2289 | 474.0 | 34128 | 0.6885 | 0.2243 | | 0.2311 | 475.0 | 34200 | 0.6911 | 0.2231 | | 0.2374 | 476.0 | 34272 | 0.6834 | 0.2234 | | 0.235 | 477.0 | 34344 | 0.6790 | 0.2223 | | 0.2292 | 478.0 | 34416 | 0.6857 | 0.2233 | | 0.2243 | 479.0 | 34488 | 0.6737 | 0.2243 | | 0.235 | 480.0 | 34560 | 0.6831 | 0.2222 | | 0.2337 | 481.0 | 34632 | 0.6769 | 0.2207 | | 0.2258 | 482.0 | 34704 | 0.6784 | 0.2232 | | 0.2276 | 483.0 | 34776 | 0.6917 | 0.2241 | | 0.2379 | 484.0 | 34848 | 0.6806 | 0.2251 | | 0.229 | 485.0 | 34920 | 0.6859 | 0.2232 | | 0.2312 | 486.0 | 34992 | 0.6850 | 0.2236 | | 0.2412 | 487.0 | 35064 | 0.6776 | 0.2221 | | 0.2328 | 488.0 | 35136 | 0.6835 | 0.2230 | | 0.2373 | 489.0 | 35208 | 0.6879 | 0.2222 | | 0.234 | 490.0 | 35280 | 0.6868 | 0.2214 | | 0.2274 | 491.0 | 35352 | 0.6869 | 0.2222 | | 0.2332 | 492.0 | 35424 | 0.6861 | 0.2214 | | 0.2291 | 493.0 | 35496 | 0.6881 | 0.2206 | | 0.2301 | 494.0 | 35568 | 0.6877 | 0.2205 | | 0.2258 | 495.0 | 35640 | 0.6898 | 0.2203 | | 0.2351 | 496.0 | 35712 | 0.6883 | 0.2212 | | 0.2345 | 497.0 | 35784 | 0.6915 | 0.2213 | | 0.23 | 498.0 | 35856 | 0.6922 | 0.2217 | | 0.2257 | 499.0 | 35928 | 0.6925 | 0.2216 | | 0.2273 | 500.0 | 36000 | 0.6914 | 0.2205 | ### Framework versions - Transformers 4.21.0.dev0 - Pytorch 1.9.1+cu102 - Datasets 2.3.3.dev0 - Tokenizers 0.12.1