Edit model card

Legal_GQA_BERT_augmented_1000

This model was trained from scratch on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 5.5643

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 2e-05
  • train_batch_size: 32
  • eval_batch_size: 32
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 1000

Training results

Training Loss Epoch Step Validation Loss
No log 1.0 15 3.3883
No log 2.0 30 3.5183
No log 3.0 45 3.2108
No log 4.0 60 3.1069
No log 5.0 75 3.2101
No log 6.0 90 3.3867
No log 7.0 105 3.6980
No log 8.0 120 3.9139
No log 9.0 135 4.0341
No log 10.0 150 3.8068
No log 11.0 165 4.1122
No log 12.0 180 4.0931
No log 13.0 195 4.4698
No log 14.0 210 4.5345
No log 15.0 225 4.2682
No log 16.0 240 4.2651
No log 17.0 255 4.3404
No log 18.0 270 4.1897
No log 19.0 285 4.2439
No log 20.0 300 4.2961
No log 21.0 315 4.4664
No log 22.0 330 4.6397
No log 23.0 345 4.6983
No log 24.0 360 4.3461
No log 25.0 375 4.3599
No log 26.0 390 4.6474
No log 27.0 405 4.8310
No log 28.0 420 4.7413
No log 29.0 435 4.6552
No log 30.0 450 5.0394
No log 31.0 465 5.1472
No log 32.0 480 4.3219
No log 33.0 495 5.0297
1.0978 34.0 510 4.9553
1.0978 35.0 525 4.5924
1.0978 36.0 540 4.6446
1.0978 37.0 555 4.6058
1.0978 38.0 570 4.6765
1.0978 39.0 585 4.6653
1.0978 40.0 600 4.7802
1.0978 41.0 615 4.8281
1.0978 42.0 630 4.6197
1.0978 43.0 645 5.3967
1.0978 44.0 660 5.1220
1.0978 45.0 675 4.6703
1.0978 46.0 690 4.8150
1.0978 47.0 705 4.8910
1.0978 48.0 720 4.8554
1.0978 49.0 735 4.7086
1.0978 50.0 750 5.3159
1.0978 51.0 765 4.8209
1.0978 52.0 780 4.6739
1.0978 53.0 795 4.8043
1.0978 54.0 810 4.7875
1.0978 55.0 825 5.1071
1.0978 56.0 840 4.9139
1.0978 57.0 855 4.8034
1.0978 58.0 870 5.2768
1.0978 59.0 885 4.5211
1.0978 60.0 900 4.8944
1.0978 61.0 915 5.2514
1.0978 62.0 930 5.0131
1.0978 63.0 945 4.8093
1.0978 64.0 960 5.0798
1.0978 65.0 975 5.0009
1.0978 66.0 990 4.7921
0.545 67.0 1005 4.4796
0.545 68.0 1020 4.6143
0.545 69.0 1035 4.6604
0.545 70.0 1050 4.8758
0.545 71.0 1065 4.6794
0.545 72.0 1080 4.7766
0.545 73.0 1095 4.7499
0.545 74.0 1110 5.0082
0.545 75.0 1125 4.8711
0.545 76.0 1140 5.2020
0.545 77.0 1155 4.7688
0.545 78.0 1170 4.9599
0.545 79.0 1185 4.9073
0.545 80.0 1200 4.7357
0.545 81.0 1215 4.8469
0.545 82.0 1230 4.7376
0.545 83.0 1245 5.2470
0.545 84.0 1260 4.8735
0.545 85.0 1275 5.2453
0.545 86.0 1290 4.9205
0.545 87.0 1305 5.1069
0.545 88.0 1320 5.1398
0.545 89.0 1335 5.3820
0.545 90.0 1350 4.7635
0.545 91.0 1365 5.0217
0.545 92.0 1380 5.2565
0.545 93.0 1395 4.7166
0.545 94.0 1410 4.9733
0.545 95.0 1425 5.0055
0.545 96.0 1440 4.7976
0.545 97.0 1455 5.0151
0.545 98.0 1470 5.2870
0.545 99.0 1485 4.5921
0.5267 100.0 1500 5.0646
0.5267 101.0 1515 4.8235
0.5267 102.0 1530 5.2986
0.5267 103.0 1545 5.4820
0.5267 104.0 1560 4.8970
0.5267 105.0 1575 4.7869
0.5267 106.0 1590 4.8999
0.5267 107.0 1605 5.1031
0.5267 108.0 1620 5.2480
0.5267 109.0 1635 4.9032
0.5267 110.0 1650 4.8363
0.5267 111.0 1665 4.5870
0.5267 112.0 1680 5.1484
0.5267 113.0 1695 5.1142
0.5267 114.0 1710 4.9887
0.5267 115.0 1725 4.8359
0.5267 116.0 1740 5.3862
0.5267 117.0 1755 5.2256
0.5267 118.0 1770 5.2384
0.5267 119.0 1785 5.4806
0.5267 120.0 1800 5.4251
0.5267 121.0 1815 5.0972
0.5267 122.0 1830 5.3176
0.5267 123.0 1845 5.5421
0.5267 124.0 1860 5.3288
0.5267 125.0 1875 5.1236
0.5267 126.0 1890 4.8576
0.5267 127.0 1905 5.2399
0.5267 128.0 1920 5.1789
0.5267 129.0 1935 5.2044
0.5267 130.0 1950 5.0341
0.5267 131.0 1965 5.0332
0.5267 132.0 1980 5.3033
0.5267 133.0 1995 4.9757
0.5255 134.0 2010 4.9756
0.5255 135.0 2025 5.9108
0.5255 136.0 2040 5.1210
0.5255 137.0 2055 5.1198
0.5255 138.0 2070 4.7941
0.5255 139.0 2085 5.1223
0.5255 140.0 2100 5.5357
0.5255 141.0 2115 5.7372
0.5255 142.0 2130 5.1258
0.5255 143.0 2145 4.8953
0.5255 144.0 2160 5.3617
0.5255 145.0 2175 4.7360
0.5255 146.0 2190 5.2179
0.5255 147.0 2205 5.1701
0.5255 148.0 2220 5.1744
0.5255 149.0 2235 5.6116
0.5255 150.0 2250 4.9830
0.5255 151.0 2265 5.1670
0.5255 152.0 2280 5.3134
0.5255 153.0 2295 5.3584
0.5255 154.0 2310 5.1973
0.5255 155.0 2325 5.1849
0.5255 156.0 2340 5.0317
0.5255 157.0 2355 5.2188
0.5255 158.0 2370 5.4852
0.5255 159.0 2385 5.2943
0.5255 160.0 2400 5.0760
0.5255 161.0 2415 5.7740
0.5255 162.0 2430 4.7469
0.5255 163.0 2445 5.2974
0.5255 164.0 2460 5.5422
0.5255 165.0 2475 5.1533
0.5255 166.0 2490 5.5896
0.5186 167.0 2505 5.1866
0.5186 168.0 2520 5.3227
0.5186 169.0 2535 4.9270
0.5186 170.0 2550 4.8544
0.5186 171.0 2565 5.1769
0.5186 172.0 2580 5.4327
0.5186 173.0 2595 4.8254
0.5186 174.0 2610 4.5861
0.5186 175.0 2625 5.5166
0.5186 176.0 2640 5.3005
0.5186 177.0 2655 4.9372
0.5186 178.0 2670 4.7945
0.5186 179.0 2685 5.0823
0.5186 180.0 2700 5.4074
0.5186 181.0 2715 4.9503
0.5186 182.0 2730 4.8464
0.5186 183.0 2745 5.3896
0.5186 184.0 2760 5.3146
0.5186 185.0 2775 5.3931
0.5186 186.0 2790 5.3056
0.5186 187.0 2805 5.0436
0.5186 188.0 2820 4.8892
0.5186 189.0 2835 5.0765
0.5186 190.0 2850 5.3206
0.5186 191.0 2865 5.5881
0.5186 192.0 2880 5.3580
0.5186 193.0 2895 5.1613
0.5186 194.0 2910 5.0169
0.5186 195.0 2925 4.9202
0.5186 196.0 2940 4.6891
0.5186 197.0 2955 5.3409
0.5186 198.0 2970 5.1608
0.5186 199.0 2985 5.2628
0.5085 200.0 3000 5.3308
0.5085 201.0 3015 4.8390
0.5085 202.0 3030 4.7931
0.5085 203.0 3045 5.0549
0.5085 204.0 3060 5.2469
0.5085 205.0 3075 4.6243
0.5085 206.0 3090 5.4795
0.5085 207.0 3105 5.8197
0.5085 208.0 3120 5.6903
0.5085 209.0 3135 5.1707
0.5085 210.0 3150 5.7986
0.5085 211.0 3165 5.9958
0.5085 212.0 3180 5.1017
0.5085 213.0 3195 4.9035
0.5085 214.0 3210 4.9997
0.5085 215.0 3225 5.3660
0.5085 216.0 3240 6.0097
0.5085 217.0 3255 5.3763
0.5085 218.0 3270 5.1007
0.5085 219.0 3285 5.3806
0.5085 220.0 3300 5.3610
0.5085 221.0 3315 4.9994
0.5085 222.0 3330 5.1716
0.5085 223.0 3345 5.2661
0.5085 224.0 3360 5.0085
0.5085 225.0 3375 4.9746
0.5085 226.0 3390 5.3201
0.5085 227.0 3405 4.8567
0.5085 228.0 3420 4.8498
0.5085 229.0 3435 5.5014
0.5085 230.0 3450 5.6112
0.5085 231.0 3465 4.8397
0.5085 232.0 3480 4.9611
0.5085 233.0 3495 5.0043
0.5054 234.0 3510 4.7918
0.5054 235.0 3525 4.8298
0.5054 236.0 3540 4.9825
0.5054 237.0 3555 4.8376
0.5054 238.0 3570 4.8691
0.5054 239.0 3585 4.8771
0.5054 240.0 3600 5.1065
0.5054 241.0 3615 5.0694
0.5054 242.0 3630 4.8808
0.5054 243.0 3645 5.0120
0.5054 244.0 3660 4.9805
0.5054 245.0 3675 5.0633
0.5054 246.0 3690 4.7455
0.5054 247.0 3705 4.9925
0.5054 248.0 3720 4.8557
0.5054 249.0 3735 5.0092
0.5054 250.0 3750 4.8779
0.5054 251.0 3765 4.7464
0.5054 252.0 3780 5.1301
0.5054 253.0 3795 5.7037
0.5054 254.0 3810 5.5409
0.5054 255.0 3825 5.0423
0.5054 256.0 3840 4.8000
0.5054 257.0 3855 4.7885
0.5054 258.0 3870 5.4398
0.5054 259.0 3885 5.7013
0.5054 260.0 3900 5.4537
0.5054 261.0 3915 5.0434
0.5054 262.0 3930 4.7824
0.5054 263.0 3945 5.4242
0.5054 264.0 3960 5.6762
0.5054 265.0 3975 5.3791
0.5054 266.0 3990 5.2896
0.4997 267.0 4005 5.2966
0.4997 268.0 4020 4.9239
0.4997 269.0 4035 5.4293
0.4997 270.0 4050 5.2644
0.4997 271.0 4065 5.3648
0.4997 272.0 4080 5.0977
0.4997 273.0 4095 5.3462
0.4997 274.0 4110 5.2690
0.4997 275.0 4125 4.8537
0.4997 276.0 4140 4.6817
0.4997 277.0 4155 4.6932
0.4997 278.0 4170 4.7846
0.4997 279.0 4185 4.8426
0.4997 280.0 4200 5.0638
0.4997 281.0 4215 5.2071
0.4997 282.0 4230 5.2970
0.4997 283.0 4245 5.2301
0.4997 284.0 4260 5.1739
0.4997 285.0 4275 5.0952
0.4997 286.0 4290 5.2084
0.4997 287.0 4305 5.0338
0.4997 288.0 4320 5.1577
0.4997 289.0 4335 5.3190
0.4997 290.0 4350 5.0964
0.4997 291.0 4365 4.9452
0.4997 292.0 4380 5.0445
0.4997 293.0 4395 5.1708
0.4997 294.0 4410 5.2879
0.4997 295.0 4425 5.2042
0.4997 296.0 4440 5.2364
0.4997 297.0 4455 5.1176
0.4997 298.0 4470 5.1695
0.4997 299.0 4485 5.2149
0.4995 300.0 4500 5.4318
0.4995 301.0 4515 5.2682
0.4995 302.0 4530 5.1241
0.4995 303.0 4545 5.1414
0.4995 304.0 4560 5.2230
0.4995 305.0 4575 5.2342
0.4995 306.0 4590 5.3834
0.4995 307.0 4605 5.2761
0.4995 308.0 4620 5.0929
0.4995 309.0 4635 4.9035
0.4995 310.0 4650 4.9718
0.4995 311.0 4665 5.1214
0.4995 312.0 4680 5.1096
0.4995 313.0 4695 5.0932
0.4995 314.0 4710 5.3398
0.4995 315.0 4725 5.4340
0.4995 316.0 4740 5.2844
0.4995 317.0 4755 4.9831
0.4995 318.0 4770 5.1183
0.4995 319.0 4785 5.2450
0.4995 320.0 4800 5.1224
0.4995 321.0 4815 5.1252
0.4995 322.0 4830 5.2497
0.4995 323.0 4845 5.1165
0.4995 324.0 4860 5.2975
0.4995 325.0 4875 5.3273
0.4995 326.0 4890 5.1436
0.4995 327.0 4905 5.1417
0.4995 328.0 4920 5.2388
0.4995 329.0 4935 5.2375
0.4995 330.0 4950 5.1233
0.4995 331.0 4965 5.0836
0.4995 332.0 4980 5.0346
0.4995 333.0 4995 5.0839
0.4972 334.0 5010 5.1896
0.4972 335.0 5025 5.1835
0.4972 336.0 5040 5.1205
0.4972 337.0 5055 5.0559
0.4972 338.0 5070 5.1710
0.4972 339.0 5085 5.4036
0.4972 340.0 5100 5.5524
0.4972 341.0 5115 5.4580
0.4972 342.0 5130 5.4039
0.4972 343.0 5145 5.4564
0.4972 344.0 5160 5.3702
0.4972 345.0 5175 5.3680
0.4972 346.0 5190 5.0966
0.4972 347.0 5205 4.9537
0.4972 348.0 5220 4.9034
0.4972 349.0 5235 5.1290
0.4972 350.0 5250 5.3774
0.4972 351.0 5265 5.2119
0.4972 352.0 5280 5.1095
0.4972 353.0 5295 5.0610
0.4972 354.0 5310 5.0331
0.4972 355.0 5325 5.2939
0.4972 356.0 5340 5.3007
0.4972 357.0 5355 5.0598
0.4972 358.0 5370 5.3544
0.4972 359.0 5385 5.6056
0.4972 360.0 5400 5.1976
0.4972 361.0 5415 5.0862
0.4972 362.0 5430 5.1594
0.4972 363.0 5445 5.2028
0.4972 364.0 5460 5.3234
0.4972 365.0 5475 5.3384
0.4972 366.0 5490 5.2076
0.4978 367.0 5505 4.8249
0.4978 368.0 5520 4.7105
0.4978 369.0 5535 4.9459
0.4978 370.0 5550 5.1239
0.4978 371.0 5565 4.8861
0.4978 372.0 5580 5.3975
0.4978 373.0 5595 5.2617
0.4978 374.0 5610 5.2747
0.4978 375.0 5625 5.1127
0.4978 376.0 5640 5.1453
0.4978 377.0 5655 5.2388
0.4978 378.0 5670 5.1525
0.4978 379.0 5685 4.9960
0.4978 380.0 5700 5.3183
0.4978 381.0 5715 5.2230
0.4978 382.0 5730 5.1642
0.4978 383.0 5745 5.5691
0.4978 384.0 5760 5.3970
0.4978 385.0 5775 5.0426
0.4978 386.0 5790 5.2227
0.4978 387.0 5805 5.3170
0.4978 388.0 5820 5.3461
0.4978 389.0 5835 4.6755
0.4978 390.0 5850 4.6388
0.4978 391.0 5865 5.0258
0.4978 392.0 5880 5.2619
0.4978 393.0 5895 5.0009
0.4978 394.0 5910 4.8449
0.4978 395.0 5925 5.2422
0.4978 396.0 5940 5.2006
0.4978 397.0 5955 5.0539
0.4978 398.0 5970 5.2006
0.4978 399.0 5985 5.6585
0.4994 400.0 6000 5.1971
0.4994 401.0 6015 5.0745
0.4994 402.0 6030 5.0704
0.4994 403.0 6045 4.9562
0.4994 404.0 6060 4.9561
0.4994 405.0 6075 5.0316
0.4994 406.0 6090 4.9882
0.4994 407.0 6105 4.8941
0.4994 408.0 6120 4.7548
0.4994 409.0 6135 4.6013
0.4994 410.0 6150 4.6536
0.4994 411.0 6165 4.6243
0.4994 412.0 6180 5.0407
0.4994 413.0 6195 4.9459
0.4994 414.0 6210 5.0777
0.4994 415.0 6225 5.0159
0.4994 416.0 6240 5.3117
0.4994 417.0 6255 5.3360
0.4994 418.0 6270 5.0526
0.4994 419.0 6285 4.9438
0.4994 420.0 6300 4.7978
0.4994 421.0 6315 4.8472
0.4994 422.0 6330 4.9426
0.4994 423.0 6345 5.3218
0.4994 424.0 6360 5.7490
0.4994 425.0 6375 5.8859
0.4994 426.0 6390 6.0392
0.4994 427.0 6405 5.2821
0.4994 428.0 6420 5.0280
0.4994 429.0 6435 5.8315
0.4994 430.0 6450 5.1468
0.4994 431.0 6465 5.0407
0.4994 432.0 6480 5.2883
0.4994 433.0 6495 5.2976
0.4967 434.0 6510 5.4974
0.4967 435.0 6525 5.4830
0.4967 436.0 6540 5.1616
0.4967 437.0 6555 4.9301
0.4967 438.0 6570 5.0119
0.4967 439.0 6585 4.7559
0.4967 440.0 6600 5.0418
0.4967 441.0 6615 5.4243
0.4967 442.0 6630 5.5121
0.4967 443.0 6645 5.8842
0.4967 444.0 6660 5.6200
0.4967 445.0 6675 5.5586
0.4967 446.0 6690 5.1609
0.4967 447.0 6705 5.0849
0.4967 448.0 6720 5.0578
0.4967 449.0 6735 5.3793
0.4967 450.0 6750 5.4016
0.4967 451.0 6765 5.3670
0.4967 452.0 6780 5.3160
0.4967 453.0 6795 4.9808
0.4967 454.0 6810 4.8458
0.4967 455.0 6825 4.9124
0.4967 456.0 6840 5.4840
0.4967 457.0 6855 5.3637
0.4967 458.0 6870 5.1374
0.4967 459.0 6885 4.9231
0.4967 460.0 6900 4.8278
0.4967 461.0 6915 4.8555
0.4967 462.0 6930 4.7185
0.4967 463.0 6945 4.6139
0.4967 464.0 6960 4.8549
0.4967 465.0 6975 4.8315
0.4967 466.0 6990 5.0875
0.4979 467.0 7005 5.1814
0.4979 468.0 7020 5.1868
0.4979 469.0 7035 5.2756
0.4979 470.0 7050 5.0150
0.4979 471.0 7065 5.1885
0.4979 472.0 7080 4.9443
0.4979 473.0 7095 4.8291
0.4979 474.0 7110 5.6419
0.4979 475.0 7125 5.5896
0.4979 476.0 7140 5.4452
0.4979 477.0 7155 5.4085
0.4979 478.0 7170 5.6028
0.4979 479.0 7185 5.4702
0.4979 480.0 7200 4.8441
0.4979 481.0 7215 4.7450
0.4979 482.0 7230 5.3313
0.4979 483.0 7245 5.6255
0.4979 484.0 7260 5.5654
0.4979 485.0 7275 5.4628
0.4979 486.0 7290 5.2668
0.4979 487.0 7305 5.0661
0.4979 488.0 7320 5.2033
0.4979 489.0 7335 5.1265
0.4979 490.0 7350 5.0074
0.4979 491.0 7365 5.3748
0.4979 492.0 7380 5.3601
0.4979 493.0 7395 4.9280
0.4979 494.0 7410 5.3482
0.4979 495.0 7425 5.4246
0.4979 496.0 7440 5.6951
0.4979 497.0 7455 5.9616
0.4979 498.0 7470 5.8197
0.4979 499.0 7485 5.8076
0.5036 500.0 7500 5.6139
0.5036 501.0 7515 5.4366
0.5036 502.0 7530 5.8286
0.5036 503.0 7545 6.3671
0.5036 504.0 7560 6.0841
0.5036 505.0 7575 6.7090
0.5036 506.0 7590 6.5447
0.5036 507.0 7605 6.0607
0.5036 508.0 7620 5.7126
0.5036 509.0 7635 5.5196
0.5036 510.0 7650 5.4649
0.5036 511.0 7665 6.3131
0.5036 512.0 7680 5.9804
0.5036 513.0 7695 5.6430
0.5036 514.0 7710 5.0386
0.5036 515.0 7725 5.2494
0.5036 516.0 7740 5.9913
0.5036 517.0 7755 5.8256
0.5036 518.0 7770 5.6192
0.5036 519.0 7785 5.4887
0.5036 520.0 7800 5.2806
0.5036 521.0 7815 5.1998
0.5036 522.0 7830 5.0980
0.5036 523.0 7845 5.0953
0.5036 524.0 7860 5.5941
0.5036 525.0 7875 5.6090
0.5036 526.0 7890 5.3668
0.5036 527.0 7905 5.2642
0.5036 528.0 7920 5.1298
0.5036 529.0 7935 5.1722
0.5036 530.0 7950 4.9639
0.5036 531.0 7965 5.1111
0.5036 532.0 7980 4.9698
0.5036 533.0 7995 4.8605
0.6604 534.0 8010 4.8506
0.6604 535.0 8025 5.2930
0.6604 536.0 8040 5.4214
0.6604 537.0 8055 5.3794
0.6604 538.0 8070 5.2698
0.6604 539.0 8085 5.1952
0.6604 540.0 8100 5.2180
0.6604 541.0 8115 5.1062
0.6604 542.0 8130 5.0707
0.6604 543.0 8145 5.2226
0.6604 544.0 8160 5.2322
0.6604 545.0 8175 5.3413
0.6604 546.0 8190 5.2508
0.6604 547.0 8205 5.2101
0.6604 548.0 8220 5.0310
0.6604 549.0 8235 5.0391
0.6604 550.0 8250 5.2027
0.6604 551.0 8265 5.3648
0.6604 552.0 8280 5.4234
0.6604 553.0 8295 5.2153
0.6604 554.0 8310 5.0629
0.6604 555.0 8325 5.4140
0.6604 556.0 8340 5.7981
0.6604 557.0 8355 5.6710
0.6604 558.0 8370 5.3510
0.6604 559.0 8385 5.1841
0.6604 560.0 8400 5.1765
0.6604 561.0 8415 5.4604
0.6604 562.0 8430 5.4306
0.6604 563.0 8445 5.3153
0.6604 564.0 8460 5.1759
0.6604 565.0 8475 5.0931
0.6604 566.0 8490 5.0486
0.5019 567.0 8505 5.2054
0.5019 568.0 8520 5.2759
0.5019 569.0 8535 5.1119
0.5019 570.0 8550 4.9955
0.5019 571.0 8565 5.2179
0.5019 572.0 8580 5.6476
0.5019 573.0 8595 5.7092
0.5019 574.0 8610 5.5214
0.5019 575.0 8625 5.1430
0.5019 576.0 8640 5.0696
0.5019 577.0 8655 5.0470
0.5019 578.0 8670 4.9673
0.5019 579.0 8685 4.9646
0.5019 580.0 8700 5.0028
0.5019 581.0 8715 5.0364
0.5019 582.0 8730 5.2752
0.5019 583.0 8745 5.1951
0.5019 584.0 8760 5.0229
0.5019 585.0 8775 4.8097
0.5019 586.0 8790 4.7416
0.5019 587.0 8805 4.6862
0.5019 588.0 8820 4.9634
0.5019 589.0 8835 5.0239
0.5019 590.0 8850 4.9224
0.5019 591.0 8865 4.7897
0.5019 592.0 8880 4.8904
0.5019 593.0 8895 5.4806
0.5019 594.0 8910 5.3416
0.5019 595.0 8925 5.0692
0.5019 596.0 8940 4.6734
0.5019 597.0 8955 4.6490
0.5019 598.0 8970 5.2131
0.5019 599.0 8985 5.4504
0.4992 600.0 9000 5.4041
0.4992 601.0 9015 5.2318
0.4992 602.0 9030 5.5589
0.4992 603.0 9045 5.7415
0.4992 604.0 9060 5.6261
0.4992 605.0 9075 5.5252
0.4992 606.0 9090 5.4276
0.4992 607.0 9105 5.6103
0.4992 608.0 9120 5.8023
0.4992 609.0 9135 6.0722
0.4992 610.0 9150 6.2382
0.4992 611.0 9165 5.7711
0.4992 612.0 9180 5.5079
0.4992 613.0 9195 5.2799
0.4992 614.0 9210 5.4323
0.4992 615.0 9225 5.4008
0.4992 616.0 9240 5.5805
0.4992 617.0 9255 5.7280
0.4992 618.0 9270 5.7993
0.4992 619.0 9285 5.9613
0.4992 620.0 9300 6.0883
0.4992 621.0 9315 5.9990
0.4992 622.0 9330 6.0797
0.4992 623.0 9345 5.9562
0.4992 624.0 9360 5.9381
0.4992 625.0 9375 5.8045
0.4992 626.0 9390 5.5704
0.4992 627.0 9405 5.5531
0.4992 628.0 9420 5.8456
0.4992 629.0 9435 5.6827
0.4992 630.0 9450 5.3870
0.4992 631.0 9465 5.3042
0.4992 632.0 9480 5.2942
0.4992 633.0 9495 5.5454
0.4998 634.0 9510 6.1116
0.4998 635.0 9525 6.0389
0.4998 636.0 9540 5.8903
0.4998 637.0 9555 5.8638
0.4998 638.0 9570 5.8782
0.4998 639.0 9585 5.8438
0.4998 640.0 9600 5.7996
0.4998 641.0 9615 5.7731
0.4998 642.0 9630 5.7824
0.4998 643.0 9645 5.7007
0.4998 644.0 9660 5.5691
0.4998 645.0 9675 5.7624
0.4998 646.0 9690 5.7716
0.4998 647.0 9705 5.9719
0.4998 648.0 9720 6.1224
0.4998 649.0 9735 5.9156
0.4998 650.0 9750 6.1239
0.4998 651.0 9765 6.3004
0.4998 652.0 9780 6.1068
0.4998 653.0 9795 5.9071
0.4998 654.0 9810 5.8484
0.4998 655.0 9825 5.9861
0.4998 656.0 9840 6.1605
0.4998 657.0 9855 6.1197
0.4998 658.0 9870 6.1292
0.4998 659.0 9885 6.0706
0.4998 660.0 9900 6.1479
0.4998 661.0 9915 6.1218
0.4998 662.0 9930 6.0123
0.4998 663.0 9945 6.0480
0.4998 664.0 9960 5.8941
0.4998 665.0 9975 6.0031
0.4998 666.0 9990 6.2546
0.5923 667.0 10005 6.2910
0.5923 668.0 10020 6.2188
0.5923 669.0 10035 6.3355
0.5923 670.0 10050 6.6119
0.5923 671.0 10065 6.6850
0.5923 672.0 10080 6.5963
0.5923 673.0 10095 6.3469
0.5923 674.0 10110 6.2322
0.5923 675.0 10125 6.1839
0.5923 676.0 10140 6.1775
0.5923 677.0 10155 6.1526
0.5923 678.0 10170 6.1314
0.5923 679.0 10185 6.1132
0.5923 680.0 10200 6.1601
0.5923 681.0 10215 6.1908
0.5923 682.0 10230 6.2584
0.5923 683.0 10245 6.1588
0.5923 684.0 10260 6.1573
0.5923 685.0 10275 6.2166
0.5923 686.0 10290 6.2976
0.5923 687.0 10305 6.3211
0.5923 688.0 10320 6.3063
0.5923 689.0 10335 6.2967
0.5923 690.0 10350 6.2627
0.5923 691.0 10365 6.1830
0.5923 692.0 10380 6.0804
0.5923 693.0 10395 6.1179
0.5923 694.0 10410 6.1451
0.5923 695.0 10425 6.1011
0.5923 696.0 10440 6.0645
0.5923 697.0 10455 6.1146
0.5923 698.0 10470 5.8808
0.5923 699.0 10485 5.7619
0.7064 700.0 10500 5.7311
0.7064 701.0 10515 5.7938
0.7064 702.0 10530 5.7786
0.7064 703.0 10545 5.7964
0.7064 704.0 10560 5.8001
0.7064 705.0 10575 5.7752
0.7064 706.0 10590 5.8255
0.7064 707.0 10605 5.8392
0.7064 708.0 10620 5.7647
0.7064 709.0 10635 5.7353
0.7064 710.0 10650 5.7048
0.7064 711.0 10665 5.5996
0.7064 712.0 10680 5.5878
0.7064 713.0 10695 5.7577
0.7064 714.0 10710 5.9443
0.7064 715.0 10725 5.8343
0.7064 716.0 10740 5.4318
0.7064 717.0 10755 4.9901
0.7064 718.0 10770 4.9130
0.7064 719.0 10785 4.9117
0.7064 720.0 10800 5.0154
0.7064 721.0 10815 5.0084
0.7064 722.0 10830 5.1422
0.7064 723.0 10845 5.0717
0.7064 724.0 10860 5.0809
0.7064 725.0 10875 5.0924
0.7064 726.0 10890 5.2967
0.7064 727.0 10905 5.3354
0.7064 728.0 10920 5.2065
0.7064 729.0 10935 5.1859
0.7064 730.0 10950 5.1830
0.7064 731.0 10965 5.1984
0.7064 732.0 10980 5.2489
0.7064 733.0 10995 5.2701
0.2707 734.0 11010 5.2638
0.2707 735.0 11025 5.2799
0.2707 736.0 11040 5.2741
0.2707 737.0 11055 5.2009
0.2707 738.0 11070 5.1593
0.2707 739.0 11085 5.1933
0.2707 740.0 11100 5.2736
0.2707 741.0 11115 5.2134
0.2707 742.0 11130 5.2091
0.2707 743.0 11145 5.3040
0.2707 744.0 11160 5.3023
0.2707 745.0 11175 5.2898
0.2707 746.0 11190 5.4072
0.2707 747.0 11205 5.4512
0.2707 748.0 11220 5.4757
0.2707 749.0 11235 5.4388
0.2707 750.0 11250 5.4080
0.2707 751.0 11265 5.4032
0.2707 752.0 11280 5.2918
0.2707 753.0 11295 5.3129
0.2707 754.0 11310 5.3780
0.2707 755.0 11325 5.4531
0.2707 756.0 11340 5.4332
0.2707 757.0 11355 5.4044
0.2707 758.0 11370 5.4136
0.2707 759.0 11385 5.5340
0.2707 760.0 11400 5.5790
0.2707 761.0 11415 5.5482
0.2707 762.0 11430 5.6264
0.2707 763.0 11445 5.8851
0.2707 764.0 11460 5.7330
0.2707 765.0 11475 5.6480
0.2707 766.0 11490 5.5674
0.0511 767.0 11505 5.5781
0.0511 768.0 11520 5.6570
0.0511 769.0 11535 5.6269
0.0511 770.0 11550 5.6278
0.0511 771.0 11565 5.6705
0.0511 772.0 11580 5.6618
0.0511 773.0 11595 5.6339
0.0511 774.0 11610 5.6363
0.0511 775.0 11625 5.6435
0.0511 776.0 11640 5.6389
0.0511 777.0 11655 5.6320
0.0511 778.0 11670 5.6372
0.0511 779.0 11685 5.6333
0.0511 780.0 11700 5.6368
0.0511 781.0 11715 5.6300
0.0511 782.0 11730 5.6041
0.0511 783.0 11745 5.5749
0.0511 784.0 11760 5.6449
0.0511 785.0 11775 5.6801
0.0511 786.0 11790 5.6934
0.0511 787.0 11805 5.6518
0.0511 788.0 11820 5.6963
0.0511 789.0 11835 5.7441
0.0511 790.0 11850 5.7334
0.0511 791.0 11865 5.6666
0.0511 792.0 11880 5.6623
0.0511 793.0 11895 5.7586
0.0511 794.0 11910 5.8472
0.0511 795.0 11925 5.7668
0.0511 796.0 11940 5.6418
0.0511 797.0 11955 5.5872
0.0511 798.0 11970 5.5856
0.0511 799.0 11985 5.5653
0.0515 800.0 12000 5.5254
0.0515 801.0 12015 5.5330
0.0515 802.0 12030 5.5400
0.0515 803.0 12045 5.5848
0.0515 804.0 12060 5.5558
0.0515 805.0 12075 5.5493
0.0515 806.0 12090 5.5860
0.0515 807.0 12105 5.6588
0.0515 808.0 12120 5.6884
0.0515 809.0 12135 5.7221
0.0515 810.0 12150 5.7433
0.0515 811.0 12165 5.7339
0.0515 812.0 12180 5.7431
0.0515 813.0 12195 5.7442
0.0515 814.0 12210 5.7083
0.0515 815.0 12225 5.6989
0.0515 816.0 12240 5.6819
0.0515 817.0 12255 5.6675
0.0515 818.0 12270 5.7094
0.0515 819.0 12285 5.7429
0.0515 820.0 12300 5.6944
0.0515 821.0 12315 5.6820
0.0515 822.0 12330 5.6845
0.0515 823.0 12345 5.6769
0.0515 824.0 12360 5.6603
0.0515 825.0 12375 5.6068
0.0515 826.0 12390 5.5916
0.0515 827.0 12405 5.5812
0.0515 828.0 12420 5.5622
0.0515 829.0 12435 5.5092
0.0515 830.0 12450 5.5535
0.0515 831.0 12465 5.6417
0.0515 832.0 12480 5.6271
0.0515 833.0 12495 5.6190
0.0509 834.0 12510 5.6104
0.0509 835.0 12525 5.6628
0.0509 836.0 12540 5.6305
0.0509 837.0 12555 5.6124
0.0509 838.0 12570 5.5684
0.0509 839.0 12585 5.6218
0.0509 840.0 12600 5.6434
0.0509 841.0 12615 5.6391
0.0509 842.0 12630 5.5947
0.0509 843.0 12645 5.5518
0.0509 844.0 12660 5.5560
0.0509 845.0 12675 5.5736
0.0509 846.0 12690 5.6000
0.0509 847.0 12705 5.6151
0.0509 848.0 12720 5.6041
0.0509 849.0 12735 5.5667
0.0509 850.0 12750 5.5639
0.0509 851.0 12765 5.6016
0.0509 852.0 12780 5.6600
0.0509 853.0 12795 5.6683
0.0509 854.0 12810 5.7113
0.0509 855.0 12825 5.7104
0.0509 856.0 12840 5.7054
0.0509 857.0 12855 5.6634
0.0509 858.0 12870 5.6516
0.0509 859.0 12885 5.6770
0.0509 860.0 12900 5.7144
0.0509 861.0 12915 5.8040
0.0509 862.0 12930 5.8090
0.0509 863.0 12945 5.7153
0.0509 864.0 12960 5.6680
0.0509 865.0 12975 5.5891
0.0509 866.0 12990 5.6036
0.0515 867.0 13005 5.5261
0.0515 868.0 13020 5.6082
0.0515 869.0 13035 5.7385
0.0515 870.0 13050 5.7956
0.0515 871.0 13065 5.8090
0.0515 872.0 13080 5.7765
0.0515 873.0 13095 5.7557
0.0515 874.0 13110 5.7394
0.0515 875.0 13125 5.7341
0.0515 876.0 13140 5.7921
0.0515 877.0 13155 5.7241
0.0515 878.0 13170 5.7030
0.0515 879.0 13185 5.6677
0.0515 880.0 13200 5.6566
0.0515 881.0 13215 5.6522
0.0515 882.0 13230 5.6398
0.0515 883.0 13245 5.6450
0.0515 884.0 13260 5.6557
0.0515 885.0 13275 5.6733
0.0515 886.0 13290 5.7079
0.0515 887.0 13305 5.7534
0.0515 888.0 13320 5.7616
0.0515 889.0 13335 5.7321
0.0515 890.0 13350 5.7113
0.0515 891.0 13365 5.7003
0.0515 892.0 13380 5.6786
0.0515 893.0 13395 5.6726
0.0515 894.0 13410 5.6770
0.0515 895.0 13425 5.6416
0.0515 896.0 13440 5.6202
0.0515 897.0 13455 5.6322
0.0515 898.0 13470 5.6403
0.0515 899.0 13485 5.7058
0.0509 900.0 13500 5.7339
0.0509 901.0 13515 5.7025
0.0509 902.0 13530 5.7024
0.0509 903.0 13545 5.7265
0.0509 904.0 13560 5.7009
0.0509 905.0 13575 5.6895
0.0509 906.0 13590 5.7018
0.0509 907.0 13605 5.6948
0.0509 908.0 13620 5.6614
0.0509 909.0 13635 5.6015
0.0509 910.0 13650 5.5796
0.0509 911.0 13665 5.5774
0.0509 912.0 13680 5.5800
0.0509 913.0 13695 5.5879
0.0509 914.0 13710 5.5850
0.0509 915.0 13725 5.5700
0.0509 916.0 13740 5.5868
0.0509 917.0 13755 5.6000
0.0509 918.0 13770 5.6165
0.0509 919.0 13785 5.6243
0.0509 920.0 13800 5.6199
0.0509 921.0 13815 5.6209
0.0509 922.0 13830 5.6377
0.0509 923.0 13845 5.6431
0.0509 924.0 13860 5.6544
0.0509 925.0 13875 5.6521
0.0509 926.0 13890 5.6490
0.0509 927.0 13905 5.6535
0.0509 928.0 13920 5.6498
0.0509 929.0 13935 5.6600
0.0509 930.0 13950 5.6613
0.0509 931.0 13965 5.6576
0.0509 932.0 13980 5.6689
0.0509 933.0 13995 5.6842
0.0513 934.0 14010 5.6979
0.0513 935.0 14025 5.6919
0.0513 936.0 14040 5.6860
0.0513 937.0 14055 5.6731
0.0513 938.0 14070 5.6546
0.0513 939.0 14085 5.6584
0.0513 940.0 14100 5.6556
0.0513 941.0 14115 5.6550
0.0513 942.0 14130 5.6741
0.0513 943.0 14145 5.6691
0.0513 944.0 14160 5.6874
0.0513 945.0 14175 5.6866
0.0513 946.0 14190 5.6379
0.0513 947.0 14205 5.6328
0.0513 948.0 14220 5.6071
0.0513 949.0 14235 5.5959
0.0513 950.0 14250 5.5864
0.0513 951.0 14265 5.5705
0.0513 952.0 14280 5.5751
0.0513 953.0 14295 5.5644
0.0513 954.0 14310 5.5499
0.0513 955.0 14325 5.5551
0.0513 956.0 14340 5.5512
0.0513 957.0 14355 5.5578
0.0513 958.0 14370 5.5631
0.0513 959.0 14385 5.5935
0.0513 960.0 14400 5.6059
0.0513 961.0 14415 5.6193
0.0513 962.0 14430 5.6168
0.0513 963.0 14445 5.6170
0.0513 964.0 14460 5.6137
0.0513 965.0 14475 5.6079
0.0513 966.0 14490 5.6128
0.0507 967.0 14505 5.6038
0.0507 968.0 14520 5.5923
0.0507 969.0 14535 5.5871
0.0507 970.0 14550 5.5726
0.0507 971.0 14565 5.5806
0.0507 972.0 14580 5.5893
0.0507 973.0 14595 5.5825
0.0507 974.0 14610 5.5785
0.0507 975.0 14625 5.5792
0.0507 976.0 14640 5.5787
0.0507 977.0 14655 5.5765
0.0507 978.0 14670 5.5588
0.0507 979.0 14685 5.5557
0.0507 980.0 14700 5.5608
0.0507 981.0 14715 5.5670
0.0507 982.0 14730 5.5633
0.0507 983.0 14745 5.5671
0.0507 984.0 14760 5.5658
0.0507 985.0 14775 5.5648
0.0507 986.0 14790 5.5612
0.0507 987.0 14805 5.5620
0.0507 988.0 14820 5.5596
0.0507 989.0 14835 5.5589
0.0507 990.0 14850 5.5617
0.0507 991.0 14865 5.5616
0.0507 992.0 14880 5.5646
0.0507 993.0 14895 5.5653
0.0507 994.0 14910 5.5637
0.0507 995.0 14925 5.5619
0.0507 996.0 14940 5.5629
0.0507 997.0 14955 5.5635
0.0507 998.0 14970 5.5639
0.0507 999.0 14985 5.5643
0.0511 1000.0 15000 5.5643

Framework versions

  • Transformers 4.36.2
  • Pytorch 2.1.2+cu121
  • Datasets 2.14.7
  • Tokenizers 0.15.0
Downloads last month
3
Safetensors
Model size
108M params
Tensor type
F32