muhtasham/bert-tiny-finetuned-nan-labels-new-longer

bert_uncased_L-2_H-128_A-2-nan-labels-new-longer

This model is a fine-tuned version of google/bert_uncased_L-2_H-128_A-2 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 8.4563

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 32
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 1000

Training results

Training Loss	Epoch	Step	Validation Loss
6.445	1.0	14	6.4988
5.9033	2.0	28	6.4333
5.6732	3.0	42	6.4295
5.6525	4.0	56	6.3895
5.4781	5.0	70	6.3660
5.31	6.0	84	6.4213
5.1629	7.0	98	6.3842
5.1541	8.0	112	6.4043
5.0659	9.0	126	6.4686
4.8597	10.0	140	6.4760
4.983	11.0	154	6.4753
4.9563	12.0	168	6.4612
4.8113	13.0	182	6.5363
4.86	14.0	196	6.5400
4.8254	15.0	210	6.5595
4.8032	16.0	224	6.5575
4.7343	17.0	238	6.5832
4.835	18.0	252	6.5729
4.6986	19.0	266	6.5705
4.6607	20.0	280	6.6127
4.6594	21.0	294	6.6145
4.6936	22.0	308	6.6280
4.6328	23.0	322	6.6249
4.6668	24.0	336	6.6779
4.5523	25.0	350	6.6236
4.3964	26.0	364	6.6895
4.4736	27.0	378	6.6899
4.5163	28.0	392	6.6832
4.5136	29.0	406	6.7013
4.542	30.0	420	6.6983
4.4362	31.0	434	6.7516
4.4466	32.0	448	6.7302
4.4834	33.0	462	6.7404
4.4824	34.0	476	6.7525
4.4302	35.0	490	6.7623
4.5098	36.0	504	6.7622
4.396	37.0	518	6.8025
4.3747	38.0	532	6.7847
4.2892	39.0	546	6.8394
4.3897	40.0	560	6.8372
4.2554	41.0	574	6.7644
4.3336	42.0	588	6.7843
4.2943	43.0	602	6.7806
4.3001	44.0	616	6.7864
4.1161	45.0	630	6.8487
4.1357	46.0	644	6.8556
4.2713	47.0	658	6.7995
4.2779	48.0	672	6.8441
4.2564	49.0	686	6.8388
4.192	50.0	700	6.7896
4.1692	51.0	714	6.8261
4.2694	52.0	728	6.8535
4.2109	53.0	742	6.8533
4.1504	54.0	756	6.8946
4.1131	55.0	770	6.8696
4.1799	56.0	784	6.8739
4.1055	57.0	798	6.8651
4.0118	58.0	812	6.8689
4.176	59.0	826	6.8895
4.1773	60.0	840	6.8385
3.9761	61.0	854	6.8580
4.1002	62.0	868	6.8556
3.9164	63.0	882	6.9133
4.0154	64.0	896	6.8968
4.008	65.0	910	6.8973
4.0876	66.0	924	6.8768
3.9527	67.0	938	6.9413
3.9351	68.0	952	6.9106
4.0333	69.0	966	6.9012
3.896	70.0	980	6.9127
4.0042	71.0	994	6.9211
3.9151	72.0	1008	6.9585
3.9852	73.0	1022	6.9027
3.9913	74.0	1036	6.9333
3.8787	75.0	1050	6.9345
3.9729	76.0	1064	6.9165
3.9449	77.0	1078	6.9660
3.9416	78.0	1092	6.9462
3.9497	79.0	1106	6.9617
3.8797	80.0	1120	6.9356
3.8509	81.0	1134	6.9562
3.9021	82.0	1148	6.9400
3.8218	83.0	1162	7.0029
3.9301	84.0	1176	7.0166
3.7591	85.0	1190	6.9891
3.8889	86.0	1204	6.9830
3.8063	87.0	1218	6.9812
3.8556	88.0	1232	7.0051
3.7773	89.0	1246	6.9959
3.745	90.0	1260	7.0423
3.8139	91.0	1274	7.0781
3.7354	92.0	1288	7.0206
3.7696	93.0	1302	6.9731
3.73	94.0	1316	7.0572
3.7019	95.0	1330	7.0119
3.6302	96.0	1344	7.0238
3.675	97.0	1358	7.0348
3.746	98.0	1372	7.0385
3.7106	99.0	1386	7.0477
3.6545	100.0	1400	7.0762
3.7246	101.0	1414	7.0063
3.6707	102.0	1428	7.0343
3.7569	103.0	1442	7.0196
3.6785	104.0	1456	7.0255
3.7535	105.0	1470	7.0461
3.7011	106.0	1484	7.0381
3.6112	107.0	1498	7.0440
3.5981	108.0	1512	7.0831
3.6751	109.0	1526	7.0568
3.674	110.0	1540	7.0905
3.5554	111.0	1554	7.0955
3.5834	112.0	1568	7.0668
3.581	113.0	1582	7.0943
3.5548	114.0	1596	7.0490
3.6446	115.0	1610	7.1190
3.6142	116.0	1624	7.1366
3.5748	117.0	1638	7.1047
3.5447	118.0	1652	7.1332
3.6093	119.0	1666	7.1137
3.5694	120.0	1680	7.1010
3.4729	121.0	1694	7.1186
3.5373	122.0	1708	7.1258
3.6168	123.0	1722	7.1184
3.5654	124.0	1736	7.0982
3.4747	125.0	1750	7.0908
3.5098	126.0	1764	7.1134
3.6144	127.0	1778	7.1033
3.4529	128.0	1792	7.1376
3.4286	129.0	1806	7.1056
3.5095	130.0	1820	7.1148
3.4333	131.0	1834	7.1185
3.4879	132.0	1848	7.1704
3.4992	133.0	1862	7.1361
3.4738	134.0	1876	7.1597
3.4358	135.0	1890	7.1244
3.4648	136.0	1904	7.1762
3.3206	137.0	1918	7.1274
3.3579	138.0	1932	7.1208
3.3573	139.0	1946	7.1614
3.3504	140.0	1960	7.1241
3.4585	141.0	1974	7.1421
3.3757	142.0	1988	7.2070
3.3911	143.0	2002	7.1862
3.2857	144.0	2016	7.1925
3.3898	145.0	2030	7.2269
3.3297	146.0	2044	7.2391
3.3361	147.0	2058	7.1945
3.2097	148.0	2072	7.2095
3.4288	149.0	2086	7.1376
3.4156	150.0	2100	7.1984
3.187	151.0	2114	7.2243
3.3137	152.0	2128	7.2164
3.2102	153.0	2142	7.1742
3.2992	154.0	2156	7.2086
3.3271	155.0	2170	7.2281
3.3251	156.0	2184	7.2360
3.2512	157.0	2198	7.2302
3.2914	158.0	2212	7.2106
3.1992	159.0	2226	7.2322
3.3029	160.0	2240	7.2548
3.2309	161.0	2254	7.2132
3.1554	162.0	2268	7.2323
3.2555	163.0	2282	7.2133
3.3232	164.0	2296	7.2382
3.1486	165.0	2310	7.2681
3.2693	166.0	2324	7.2976
3.2643	167.0	2338	7.2274
3.2331	168.0	2352	7.3139
3.1568	169.0	2366	7.2261
3.1509	170.0	2380	7.3050
3.0284	171.0	2394	7.2823
3.2062	172.0	2408	7.2707
3.1281	173.0	2422	7.2902
3.1225	174.0	2436	7.2687
3.1591	175.0	2450	7.2865
3.1179	176.0	2464	7.2920
3.1785	177.0	2478	7.2559
3.2278	178.0	2492	7.2736
3.132	179.0	2506	7.3053
3.0466	180.0	2520	7.2746
3.1254	181.0	2534	7.2709
3.1826	182.0	2548	7.3136
3.1385	183.0	2562	7.3178
3.1387	184.0	2576	7.2538
3.0793	185.0	2590	7.2920
3.112	186.0	2604	7.3260
3.1013	187.0	2618	7.2720
3.1897	188.0	2632	7.2739
3.0557	189.0	2646	7.3047
3.1642	190.0	2660	7.3403
2.9943	191.0	2674	7.3406
3.0325	192.0	2688	7.2799
3.076	193.0	2702	7.2900
3.003	194.0	2716	7.3443
3.0765	195.0	2730	7.3862
2.9823	196.0	2744	7.3070
3.0833	197.0	2758	7.2606
3.0209	198.0	2772	7.3284
2.9679	199.0	2786	7.3877
3.0575	200.0	2800	7.3454
2.9928	201.0	2814	7.3847
3.092	202.0	2828	7.3738
2.976	203.0	2842	7.3941
3.0173	204.0	2856	7.3801
2.9659	205.0	2870	7.3725
3.0016	206.0	2884	7.3803
2.9815	207.0	2898	7.3499
3.0251	208.0	2912	7.3261
2.927	209.0	2926	7.3570
3.0193	210.0	2940	7.3972
3.0152	211.0	2954	7.3770
2.9104	212.0	2968	7.3326
2.9868	213.0	2982	7.3898
3.0097	214.0	2996	7.3658
3.0093	215.0	3010	7.3975
2.8546	216.0	3024	7.3948
2.8972	217.0	3038	7.3734
2.9641	218.0	3052	7.4320
2.9083	219.0	3066	7.3582
2.9185	220.0	3080	7.4126
3.0003	221.0	3094	7.3918
2.8599	222.0	3108	7.4171
2.8931	223.0	3122	7.4251
2.9109	224.0	3136	7.4426
2.9417	225.0	3150	7.4428
2.8274	226.0	3164	7.4145
2.921	227.0	3178	7.3492
2.7542	228.0	3192	7.4100
2.8775	229.0	3206	7.4288
2.7467	230.0	3220	7.4359
2.8301	231.0	3234	7.4715
2.7856	232.0	3248	7.4036
2.835	233.0	3262	7.4038
2.7665	234.0	3276	7.4919
2.8972	235.0	3290	7.4808
2.8768	236.0	3304	7.5259
2.9377	237.0	3318	7.4187
2.8489	238.0	3332	7.4590
2.8018	239.0	3346	7.4565
2.771	240.0	3360	7.4474
2.7378	241.0	3374	7.5119
2.822	242.0	3388	7.4734
2.8274	243.0	3402	7.4984
2.7732	244.0	3416	7.4829
2.7264	245.0	3430	7.4391
2.7764	246.0	3444	7.4456
2.7972	247.0	3458	7.4858
2.8231	248.0	3472	7.4760
2.778	249.0	3486	7.4380
2.7935	250.0	3500	7.4336
2.7348	251.0	3514	7.4970
2.7192	252.0	3528	7.4811
2.8108	253.0	3542	7.4547
2.837	254.0	3556	7.4830
2.6868	255.0	3570	7.5151
2.7789	256.0	3584	7.5115
2.7706	257.0	3598	7.5180
2.7904	258.0	3612	7.5158
2.7215	259.0	3626	7.5262
2.6876	260.0	3640	7.5114
2.7679	261.0	3654	7.5066
2.7742	262.0	3668	7.5035
2.6965	263.0	3682	7.4918
2.668	264.0	3696	7.5305
2.6808	265.0	3710	7.5238
2.6491	266.0	3724	7.5347
2.7307	267.0	3738	7.5175
2.6518	268.0	3752	7.5635
2.6685	269.0	3766	7.4899
2.671	270.0	3780	7.4855
2.596	271.0	3794	7.5518
2.6622	272.0	3808	7.5308
2.6684	273.0	3822	7.5955
2.6325	274.0	3836	7.5768
2.6334	275.0	3850	7.5202
2.6042	276.0	3864	7.6176
2.7439	277.0	3878	7.5369
2.6925	278.0	3892	7.5422
2.7106	279.0	3906	7.5629
2.6519	280.0	3920	7.5359
2.6044	281.0	3934	7.5619
2.6509	282.0	3948	7.5433
2.6777	283.0	3962	7.5573
2.6199	284.0	3976	7.5628
2.6685	285.0	3990	7.5710
2.6608	286.0	4004	7.6020
2.6579	287.0	4018	7.5780
2.5559	288.0	4032	7.5713
2.5091	289.0	4046	7.5912
2.6141	290.0	4060	7.6475
2.6832	291.0	4074	7.5865
2.5769	292.0	4088	7.6198
2.6432	293.0	4102	7.6058
2.5733	294.0	4116	7.5853
2.5782	295.0	4130	7.6246
2.6118	296.0	4144	7.5817
2.6894	297.0	4158	7.5868
2.5624	298.0	4172	7.5837
2.5449	299.0	4186	7.6007
2.5865	300.0	4200	7.6604
2.5366	301.0	4214	7.5909
2.4286	302.0	4228	7.6563
2.6909	303.0	4242	7.6767
2.4252	304.0	4256	7.6556
2.612	305.0	4270	7.6846
2.4793	306.0	4284	7.6279
2.5227	307.0	4298	7.6808
2.5756	308.0	4312	7.6703
2.5321	309.0	4326	7.6217
2.5568	310.0	4340	7.6381
2.507	311.0	4354	7.6528
2.5766	312.0	4368	7.6480
2.3532	313.0	4382	7.6255
2.4758	314.0	4396	7.6512
2.4304	315.0	4410	7.6606
2.4749	316.0	4424	7.6470
2.4886	317.0	4438	7.7193
2.511	318.0	4452	7.6670
2.4664	319.0	4466	7.6209
2.4981	320.0	4480	7.6819
2.4406	321.0	4494	7.6661
2.5787	322.0	4508	7.6903
2.4885	323.0	4522	7.6595
2.5796	324.0	4536	7.6882
2.4909	325.0	4550	7.7169
2.522	326.0	4564	7.6606
2.4206	327.0	4578	7.6526
2.4909	328.0	4592	7.6731
2.4543	329.0	4606	7.6822
2.4431	330.0	4620	7.6770
2.3963	331.0	4634	7.6407
2.4518	332.0	4648	7.6468
2.5734	333.0	4662	7.7206
2.4423	334.0	4676	7.6691
2.4418	335.0	4690	7.6822
2.4575	336.0	4704	7.6477
2.4671	337.0	4718	7.6888
2.3527	338.0	4732	7.7104
2.473	339.0	4746	7.7247
2.4786	340.0	4760	7.7340
2.4222	341.0	4774	7.6998
2.4812	342.0	4788	7.6996
2.3484	343.0	4802	7.6807
2.3231	344.0	4816	7.6972
2.4844	345.0	4830	7.6984
2.3757	346.0	4844	7.7091
2.4139	347.0	4858	7.7240
2.3665	348.0	4872	7.7681
2.3942	349.0	4886	7.7129
2.2922	350.0	4900	7.6804
2.4234	351.0	4914	7.7445
2.3589	352.0	4928	7.7599
2.3987	353.0	4942	7.7381
2.3545	354.0	4956	7.7433
2.4019	355.0	4970	7.7560
2.2925	356.0	4984	7.7393
2.3678	357.0	4998	7.7211
2.3588	358.0	5012	7.7414
2.3996	359.0	5026	7.7436
2.3665	360.0	5040	7.7966
2.3374	361.0	5054	7.8225
2.3667	362.0	5068	7.7955
2.3754	363.0	5082	7.7731
2.4179	364.0	5096	7.7899
2.3777	365.0	5110	7.7831
2.4064	366.0	5124	7.7861
2.3371	367.0	5138	7.7578
2.4169	368.0	5152	7.8429
2.3491	369.0	5166	7.7645
2.2275	370.0	5180	7.8063
2.2605	371.0	5194	7.8280
2.3506	372.0	5208	7.7356
2.403	373.0	5222	7.7739
2.3188	374.0	5236	7.7634
2.3294	375.0	5250	7.8033
2.2724	376.0	5264	7.8423
2.2704	377.0	5278	7.8340
2.2606	378.0	5292	7.7941
2.2599	379.0	5306	7.8336
2.326	380.0	5320	7.8080
2.2861	381.0	5334	7.8097
2.2559	382.0	5348	7.8201
2.2612	383.0	5362	7.8249
2.3161	384.0	5376	7.8353
2.2061	385.0	5390	7.8623
2.4231	386.0	5404	7.8568
2.2481	387.0	5418	7.8642
2.2319	388.0	5432	7.8255
2.2178	389.0	5446	7.8136
2.3153	390.0	5460	7.8549
2.2391	391.0	5474	7.8739
2.2736	392.0	5488	7.9016
2.3335	393.0	5502	7.8838
2.2069	394.0	5516	7.9268
2.303	395.0	5530	7.8096
2.2585	396.0	5544	7.8667
2.2261	397.0	5558	7.8651
2.2792	398.0	5572	7.8213
2.3172	399.0	5586	7.8702
2.2787	400.0	5600	7.8745
2.226	401.0	5614	7.8490
2.1491	402.0	5628	7.8608
2.2121	403.0	5642	7.8568
2.1715	404.0	5656	7.8996
2.1613	405.0	5670	7.8920
2.1886	406.0	5684	7.8223
2.1392	407.0	5698	7.8254
2.2268	408.0	5712	7.8583
2.2726	409.0	5726	7.8749
2.1648	410.0	5740	7.9115
2.1897	411.0	5754	7.9030
2.1597	412.0	5768	7.8699
2.1989	413.0	5782	7.8932
2.2705	414.0	5796	7.8936
2.1071	415.0	5810	7.8695
2.124	416.0	5824	7.8873
2.1948	417.0	5838	7.8655
2.2704	418.0	5852	7.9172
2.2055	419.0	5866	7.9646
2.276	420.0	5880	7.9224
2.1541	421.0	5894	7.8567
2.1881	422.0	5908	7.8945
2.1455	423.0	5922	7.8674
2.3452	424.0	5936	7.9724
2.1371	425.0	5950	7.9671
2.1901	426.0	5964	7.9274
2.1643	427.0	5978	7.9121
2.2229	428.0	5992	7.8934
2.1254	429.0	6006	7.9270
2.1554	430.0	6020	7.9205
2.0761	431.0	6034	7.9256
2.1551	432.0	6048	7.9133
2.2451	433.0	6062	7.9323
2.1491	434.0	6076	7.9551
2.1766	435.0	6090	7.9279
2.1239	436.0	6104	7.8983
2.1505	437.0	6118	7.9169
2.153	438.0	6132	7.9516
2.0899	439.0	6146	7.9140
2.1215	440.0	6160	7.9224
2.0644	441.0	6174	7.9485
2.1333	442.0	6188	7.9633
2.0807	443.0	6202	7.9847
2.1222	444.0	6216	7.9519
2.0775	445.0	6230	7.9995
2.1712	446.0	6244	7.9453
2.1816	447.0	6258	7.9563
2.071	448.0	6272	7.9443
2.083	449.0	6286	7.9434
2.166	450.0	6300	7.9449
2.1607	451.0	6314	7.9534
2.1057	452.0	6328	7.9520
2.1258	453.0	6342	7.9578
2.0822	454.0	6356	7.9709
2.0092	455.0	6370	8.0117
2.055	456.0	6384	7.9800
2.0325	457.0	6398	7.9150
2.0546	458.0	6412	7.9607
2.0677	459.0	6426	7.9714
2.1351	460.0	6440	7.9851
2.0859	461.0	6454	8.0055
2.0274	462.0	6468	7.9691
2.0006	463.0	6482	7.9561
2.1271	464.0	6496	7.9346
2.0637	465.0	6510	8.0015
2.0727	466.0	6524	8.0062
1.983	467.0	6538	8.0255
2.0895	468.0	6552	7.9777
2.1187	469.0	6566	7.9704
2.0874	470.0	6580	7.9550
2.0927	471.0	6594	7.9987
2.1442	472.0	6608	8.0421
2.0117	473.0	6622	8.0121
2.0647	474.0	6636	7.9565
2.0095	475.0	6650	7.9986
2.0008	476.0	6664	8.0411
2.0464	477.0	6678	7.9803
2.1314	478.0	6692	8.0383
2.0345	479.0	6706	7.9776
2.0668	480.0	6720	8.0702
2.0933	481.0	6734	8.0149
2.0612	482.0	6748	8.0105
1.9858	483.0	6762	7.9859
2.0195	484.0	6776	7.9764
2.0203	485.0	6790	8.0284
1.9986	486.0	6804	7.9929
2.0372	487.0	6818	7.9623
1.9485	488.0	6832	8.0172
1.9316	489.0	6846	7.9999
2.0008	490.0	6860	7.9783
2.0899	491.0	6874	8.0318
2.0078	492.0	6888	7.9986
2.0386	493.0	6902	8.0367
2.006	494.0	6916	8.0206
1.981	495.0	6930	8.0008
2.0464	496.0	6944	8.0056
1.9485	497.0	6958	8.0243
2.0409	498.0	6972	8.0541
2.0374	499.0	6986	8.0330
2.0073	500.0	7000	8.0471
2.0605	501.0	7014	8.0782
2.0424	502.0	7028	8.0568
2.0192	503.0	7042	8.0502
1.9831	504.0	7056	8.0580
2.1012	505.0	7070	8.0488
1.9765	506.0	7084	8.0293
2.0735	507.0	7098	8.0325
1.9964	508.0	7112	8.0104
1.9963	509.0	7126	8.0233
2.0252	510.0	7140	8.0312
1.9223	511.0	7154	8.0337
2.0063	512.0	7168	8.0609
2.0272	513.0	7182	8.0299
1.9498	514.0	7196	8.0298
2.0057	515.0	7210	8.0949
1.9598	516.0	7224	8.0999
1.949	517.0	7238	8.0914
2.0215	518.0	7252	8.0730
2.0068	519.0	7266	8.0657
1.9337	520.0	7280	8.0926
2.0259	521.0	7294	8.0900
1.9699	522.0	7308	8.0874
1.9511	523.0	7322	8.1374
1.8801	524.0	7336	8.0852
2.0123	525.0	7350	8.0754
1.9374	526.0	7364	8.0685
1.9303	527.0	7378	8.0832
1.963	528.0	7392	8.0756
1.9235	529.0	7406	8.1209
1.9476	530.0	7420	8.1116
1.8567	531.0	7434	8.0481
1.95	532.0	7448	8.0793
1.9672	533.0	7462	8.0927
1.8384	534.0	7476	8.1191
1.9117	535.0	7490	8.0865
2.0308	536.0	7504	8.0930
1.9107	537.0	7518	8.0952
1.9407	538.0	7532	8.1373
1.9409	539.0	7546	8.1064
1.9787	540.0	7560	8.1079
1.8791	541.0	7574	8.0920
1.9495	542.0	7588	8.0910
1.9265	543.0	7602	8.1203
1.8949	544.0	7616	8.1223
1.8861	545.0	7630	8.1458
1.9369	546.0	7644	8.0948
1.9234	547.0	7658	8.1073
1.934	548.0	7672	8.1285
1.947	549.0	7686	8.1476
1.9623	550.0	7700	8.1491
1.8069	551.0	7714	8.1058
1.9387	552.0	7728	8.1616
1.9291	553.0	7742	8.1207
1.9894	554.0	7756	8.1887
1.885	555.0	7770	8.1785
1.9515	556.0	7784	8.1555
1.9123	557.0	7798	8.1708
1.922	558.0	7812	8.1977
1.8818	559.0	7826	8.1429
1.9557	560.0	7840	8.1483
1.9005	561.0	7854	8.1108
1.91	562.0	7868	8.1745
1.8598	563.0	7882	8.1938
1.9633	564.0	7896	8.1294
1.8658	565.0	7910	8.1407
1.9256	566.0	7924	8.1767
1.8974	567.0	7938	8.1441
1.9635	568.0	7952	8.1219
1.9537	569.0	7966	8.2357
1.8828	570.0	7980	8.1944
1.8594	571.0	7994	8.1265
1.9105	572.0	8008	8.1458
1.9491	573.0	8022	8.2029
1.858	574.0	8036	8.1726
1.8092	575.0	8050	8.1803
1.9622	576.0	8064	8.1810
1.8717	577.0	8078	8.1521
1.9348	578.0	8092	8.1459
1.8003	579.0	8106	8.1740
1.9229	580.0	8120	8.1872
1.8093	581.0	8134	8.2038
1.9837	582.0	8148	8.1909
1.8906	583.0	8162	8.1823
1.8431	584.0	8176	8.1623
1.8505	585.0	8190	8.1838
1.8382	586.0	8204	8.1491
1.8919	587.0	8218	8.1562
1.8959	588.0	8232	8.1811
1.8002	589.0	8246	8.1789
1.8076	590.0	8260	8.2051
1.9212	591.0	8274	8.2004
1.8934	592.0	8288	8.2180
1.8699	593.0	8302	8.1870
1.8572	594.0	8316	8.1486
1.7875	595.0	8330	8.2182
1.8563	596.0	8344	8.1820
1.8471	597.0	8358	8.1865
1.8371	598.0	8372	8.1725
1.8167	599.0	8386	8.1666
1.8224	600.0	8400	8.2022
1.866	601.0	8414	8.2027
1.874	602.0	8428	8.2203
1.8575	603.0	8442	8.2109
1.898	604.0	8456	8.2598
1.8262	605.0	8470	8.2069
1.8849	606.0	8484	8.2478
1.8462	607.0	8498	8.1577
1.8755	608.0	8512	8.1992
1.7482	609.0	8526	8.1532
1.8244	610.0	8540	8.1482
1.9027	611.0	8554	8.2278
1.8474	612.0	8568	8.1938
1.8069	613.0	8582	8.1854
1.8422	614.0	8596	8.1945
1.8573	615.0	8610	8.2083
1.8114	616.0	8624	8.1864
1.873	617.0	8638	8.1902
1.7979	618.0	8652	8.2742
1.89	619.0	8666	8.2423
1.7861	620.0	8680	8.1962
1.7954	621.0	8694	8.2001
1.8347	622.0	8708	8.2490
1.8261	623.0	8722	8.2301
1.897	624.0	8736	8.2063
1.8098	625.0	8750	8.2428
1.7802	626.0	8764	8.1885
1.7771	627.0	8778	8.2032
1.7692	628.0	8792	8.2384
1.811	629.0	8806	8.2471
1.8642	630.0	8820	8.2354
1.7502	631.0	8834	8.2632
1.7271	632.0	8848	8.2109
1.8253	633.0	8862	8.2887
1.8223	634.0	8876	8.2433
1.7773	635.0	8890	8.2796
1.8149	636.0	8904	8.2290
1.8752	637.0	8918	8.2510
1.7794	638.0	8932	8.2484
1.7915	639.0	8946	8.2695
1.8358	640.0	8960	8.2513
1.7247	641.0	8974	8.2551
1.7591	642.0	8988	8.2442
1.8144	643.0	9002	8.2554
1.8404	644.0	9016	8.2240
1.7369	645.0	9030	8.2431
1.843	646.0	9044	8.2290
1.7177	647.0	9058	8.2729
1.8483	648.0	9072	8.2534
1.7889	649.0	9086	8.2305
1.8154	650.0	9100	8.2466
1.8509	651.0	9114	8.2273
1.7917	652.0	9128	8.2738
1.8168	653.0	9142	8.2925
1.7778	654.0	9156	8.2309
1.7742	655.0	9170	8.3030
1.8136	656.0	9184	8.3185
1.8294	657.0	9198	8.2920
1.8047	658.0	9212	8.3148
1.7153	659.0	9226	8.2667
1.7697	660.0	9240	8.2409
1.7956	661.0	9254	8.2493
1.8108	662.0	9268	8.2775
1.803	663.0	9282	8.2568
1.7745	664.0	9296	8.3051
1.71	665.0	9310	8.2639
1.8429	666.0	9324	8.2843
1.8034	667.0	9338	8.2691
1.7898	668.0	9352	8.2818
1.7216	669.0	9366	8.2681
1.7471	670.0	9380	8.2749
1.7109	671.0	9394	8.2923
1.7778	672.0	9408	8.2664
1.8218	673.0	9422	8.2983
1.7237	674.0	9436	8.2641
1.8237	675.0	9450	8.3240
1.7559	676.0	9464	8.3063
1.7773	677.0	9478	8.3280
1.7547	678.0	9492	8.2927
1.6821	679.0	9506	8.2964
1.8102	680.0	9520	8.2998
1.8004	681.0	9534	8.3655
1.7746	682.0	9548	8.3189
1.8222	683.0	9562	8.2932
1.8087	684.0	9576	8.3033
1.715	685.0	9590	8.3314
1.7371	686.0	9604	8.3448
1.759	687.0	9618	8.3417
1.7048	688.0	9632	8.3500
1.7708	689.0	9646	8.3246
1.6673	690.0	9660	8.2900
1.6932	691.0	9674	8.3128
1.7716	692.0	9688	8.3368
1.7829	693.0	9702	8.3166
1.7432	694.0	9716	8.3375
1.7885	695.0	9730	8.3004
1.6967	696.0	9744	8.3142
1.7928	697.0	9758	8.3387
1.7313	698.0	9772	8.3486
1.7433	699.0	9786	8.3254
1.7374	700.0	9800	8.3218
1.7113	701.0	9814	8.3249
1.824	702.0	9828	8.3451
1.7261	703.0	9842	8.3510
1.7163	704.0	9856	8.2824
1.7039	705.0	9870	8.3193
1.8078	706.0	9884	8.3046
1.6971	707.0	9898	8.3212
1.7463	708.0	9912	8.3486
1.8218	709.0	9926	8.3098
1.6471	710.0	9940	8.3217
1.7754	711.0	9954	8.3398
1.7055	712.0	9968	8.3509
1.766	713.0	9982	8.3146
1.7345	714.0	9996	8.3196
1.6768	715.0	10010	8.3553
1.7612	716.0	10024	8.3631
1.7521	717.0	10038	8.3646
1.6671	718.0	10052	8.3086
1.7135	719.0	10066	8.2903
1.7517	720.0	10080	8.3451
1.717	721.0	10094	8.3280
1.68	722.0	10108	8.3040
1.6721	723.0	10122	8.3266
1.754	724.0	10136	8.3336
1.7325	725.0	10150	8.3339
1.7358	726.0	10164	8.3686
1.7289	727.0	10178	8.3741
1.7527	728.0	10192	8.3647
1.76	729.0	10206	8.3406
1.6752	730.0	10220	8.3416
1.7191	731.0	10234	8.3513
1.6671	732.0	10248	8.3225
1.6836	733.0	10262	8.3430
1.6908	734.0	10276	8.3472
1.7494	735.0	10290	8.3647
1.6724	736.0	10304	8.3764
1.6974	737.0	10318	8.3277
1.7013	738.0	10332	8.3778
1.6729	739.0	10346	8.3322
1.8026	740.0	10360	8.3381
1.6888	741.0	10374	8.3736
1.6897	742.0	10388	8.3559
1.7499	743.0	10402	8.3814
1.7797	744.0	10416	8.3995
1.721	745.0	10430	8.3645
1.6995	746.0	10444	8.3575
1.7551	747.0	10458	8.4008
1.7368	748.0	10472	8.3599
1.7195	749.0	10486	8.3410
1.7507	750.0	10500	8.3658
1.7005	751.0	10514	8.4275
1.6815	752.0	10528	8.3222
1.6997	753.0	10542	8.3840
1.6468	754.0	10556	8.3706
1.6624	755.0	10570	8.3680
1.5879	756.0	10584	8.3976
1.6258	757.0	10598	8.3567
1.7074	758.0	10612	8.3864
1.7027	759.0	10626	8.3520
1.6504	760.0	10640	8.3882
1.6845	761.0	10654	8.3807
1.7722	762.0	10668	8.3434
1.6156	763.0	10682	8.3492
1.6982	764.0	10696	8.3609
1.5971	765.0	10710	8.3505
1.6788	766.0	10724	8.3395
1.6914	767.0	10738	8.3510
1.6657	768.0	10752	8.3490
1.7517	769.0	10766	8.4295
1.7012	770.0	10780	8.4127
1.7077	771.0	10794	8.3815
1.6822	772.0	10808	8.3643
1.6829	773.0	10822	8.3655
1.6339	774.0	10836	8.3908
1.7569	775.0	10850	8.4011
1.6163	776.0	10864	8.3726
1.6662	777.0	10878	8.3592
1.7537	778.0	10892	8.3498
1.7627	779.0	10906	8.3889
1.6896	780.0	10920	8.3925
1.6477	781.0	10934	8.4438
1.7155	782.0	10948	8.3910
1.6333	783.0	10962	8.4093
1.6535	784.0	10976	8.3662
1.6402	785.0	10990	8.3895
1.6792	786.0	11004	8.3827
1.7202	787.0	11018	8.4082
1.6361	788.0	11032	8.3915
1.6595	789.0	11046	8.4216
1.769	790.0	11060	8.4089
1.6114	791.0	11074	8.4081
1.5996	792.0	11088	8.4095
1.7636	793.0	11102	8.3521
1.784	794.0	11116	8.3744
1.5987	795.0	11130	8.4044
1.658	796.0	11144	8.3545
1.6428	797.0	11158	8.4194
1.6785	798.0	11172	8.4275
1.7494	799.0	11186	8.4095
1.6773	800.0	11200	8.4406
1.6574	801.0	11214	8.4203
1.6295	802.0	11228	8.4089
1.6853	803.0	11242	8.4302
1.721	804.0	11256	8.3972
1.6818	805.0	11270	8.4153
1.6791	806.0	11284	8.3946
1.6934	807.0	11298	8.4320
1.6146	808.0	11312	8.3993
1.6572	809.0	11326	8.3965
1.6294	810.0	11340	8.4332
1.6696	811.0	11354	8.3637
1.6836	812.0	11368	8.3735
1.6584	813.0	11382	8.3858
1.6558	814.0	11396	8.4076
1.6694	815.0	11410	8.4261
1.6832	816.0	11424	8.3389
1.6495	817.0	11438	8.3707
1.6634	818.0	11452	8.4203
1.6297	819.0	11466	8.3698
1.707	820.0	11480	8.4409
1.6803	821.0	11494	8.4208
1.6937	822.0	11508	8.3948
1.6568	823.0	11522	8.4195
1.6149	824.0	11536	8.3845
1.7053	825.0	11550	8.4389
1.6266	826.0	11564	8.4311
1.6433	827.0	11578	8.4266
1.6457	828.0	11592	8.4125
1.6661	829.0	11606	8.4158
1.658	830.0	11620	8.3599
1.6571	831.0	11634	8.3702
1.6013	832.0	11648	8.3815
1.7019	833.0	11662	8.4036
1.7593	834.0	11676	8.3840
1.6475	835.0	11690	8.4442
1.7178	836.0	11704	8.4266
1.6553	837.0	11718	8.3928
1.6011	838.0	11732	8.4062
1.7054	839.0	11746	8.4588
1.6839	840.0	11760	8.4208
1.6801	841.0	11774	8.4557
1.6917	842.0	11788	8.4300
1.6058	843.0	11802	8.4644
1.6321	844.0	11816	8.4319
1.6348	845.0	11830	8.4124
1.6118	846.0	11844	8.4667
1.6816	847.0	11858	8.4325
1.7574	848.0	11872	8.4365
1.7383	849.0	11886	8.4195
1.6522	850.0	11900	8.4343
1.61	851.0	11914	8.3775
1.5419	852.0	11928	8.4417
1.6468	853.0	11942	8.3903
1.5909	854.0	11956	8.4087
1.6376	855.0	11970	8.4391
1.6814	856.0	11984	8.3896
1.709	857.0	11998	8.4093
1.6551	858.0	12012	8.4793
1.6193	859.0	12026	8.4586
1.5831	860.0	12040	8.4748
1.6869	861.0	12054	8.4088
1.5926	862.0	12068	8.4639
1.6037	863.0	12082	8.4009
1.6878	864.0	12096	8.4111
1.6304	865.0	12110	8.4439
1.6106	866.0	12124	8.4202
1.706	867.0	12138	8.4072
1.6757	868.0	12152	8.4280
1.6875	869.0	12166	8.4363
1.6446	870.0	12180	8.4161
1.6064	871.0	12194	8.4567
1.6919	872.0	12208	8.3782
1.7078	873.0	12222	8.4134
1.6615	874.0	12236	8.4309
1.6502	875.0	12250	8.4540
1.6191	876.0	12264	8.4217
1.5853	877.0	12278	8.4459
1.6026	878.0	12292	8.4472
1.5958	879.0	12306	8.4375
1.578	880.0	12320	8.4241
1.6237	881.0	12334	8.4755
1.6813	882.0	12348	8.4056
1.6387	883.0	12362	8.3981
1.6507	884.0	12376	8.3909
1.6125	885.0	12390	8.4215
1.5733	886.0	12404	8.4279
1.6605	887.0	12418	8.4636
1.5989	888.0	12432	8.3820
1.6497	889.0	12446	8.4128
1.7232	890.0	12460	8.3742
1.5997	891.0	12474	8.4520
1.6266	892.0	12488	8.4202
1.5987	893.0	12502	8.3965
1.61	894.0	12516	8.4320
1.6795	895.0	12530	8.4613
1.6943	896.0	12544	8.4632
1.684	897.0	12558	8.4431
1.5806	898.0	12572	8.4409
1.6391	899.0	12586	8.4435
1.5754	900.0	12600	8.4244
1.617	901.0	12614	8.5100
1.6577	902.0	12628	8.4541
1.6852	903.0	12642	8.4127
1.6827	904.0	12656	8.4485
1.7296	905.0	12670	8.4526
1.6258	906.0	12684	8.4508
1.6527	907.0	12698	8.4121
1.6281	908.0	12712	8.4373
1.669	909.0	12726	8.4089
1.6757	910.0	12740	8.4098
1.5908	911.0	12754	8.4633
1.5935	912.0	12768	8.4115
1.7143	913.0	12782	8.4141
1.6203	914.0	12796	8.4084
1.5932	915.0	12810	8.4168
1.5663	916.0	12824	8.4124
1.7151	917.0	12838	8.4289
1.5585	918.0	12852	8.4381
1.5971	919.0	12866	8.4276
1.618	920.0	12880	8.5005
1.6389	921.0	12894	8.4777
1.6325	922.0	12908	8.4180
1.5971	923.0	12922	8.4586
1.662	924.0	12936	8.4755
1.5642	925.0	12950	8.4858
1.6417	926.0	12964	8.4075
1.5845	927.0	12978	8.4482
1.6328	928.0	12992	8.4674
1.6089	929.0	13006	8.4809
1.6248	930.0	13020	8.4445
1.6356	931.0	13034	8.4150
1.5573	932.0	13048	8.4527
1.5802	933.0	13062	8.4293
1.6374	934.0	13076	8.4326
1.6386	935.0	13090	8.4387
1.6332	936.0	13104	8.4280
1.6449	937.0	13118	8.4479
1.6463	938.0	13132	8.5086
1.6683	939.0	13146	8.5132
1.6339	940.0	13160	8.4324
1.6254	941.0	13174	8.3933
1.6181	942.0	13188	8.4453
1.6687	943.0	13202	8.4307
1.6226	944.0	13216	8.4446
1.6073	945.0	13230	8.4396
1.6811	946.0	13244	8.4554
1.7156	947.0	13258	8.4664
1.6668	948.0	13272	8.4237
1.5831	949.0	13286	8.4896
1.6013	950.0	13300	8.4042
1.6187	951.0	13314	8.4638
1.6534	952.0	13328	8.4318
1.5723	953.0	13342	8.4765
1.6962	954.0	13356	8.4333
1.6276	955.0	13370	8.4123
1.6247	956.0	13384	8.4544
1.5247	957.0	13398	8.5119
1.6938	958.0	13412	8.4676
1.5473	959.0	13426	8.4564
1.6351	960.0	13440	8.4216
1.5666	961.0	13454	8.4527
1.5694	962.0	13468	8.4845
1.6145	963.0	13482	8.4874
1.6097	964.0	13496	8.4375
1.5509	965.0	13510	8.4756
1.6273	966.0	13524	8.4434
1.6753	967.0	13538	8.4436
1.6287	968.0	13552	8.4596
1.6815	969.0	13566	8.4737
1.5847	970.0	13580	8.4677
1.5944	971.0	13594	8.4672
1.6673	972.0	13608	8.4842
1.6222	973.0	13622	8.4797
1.5753	974.0	13636	8.4548
1.5424	975.0	13650	8.4425
1.7219	976.0	13664	8.4936
1.6176	977.0	13678	8.4755
1.641	978.0	13692	8.5016
1.6122	979.0	13706	8.4846
1.6079	980.0	13720	8.4741
1.5988	981.0	13734	8.4980
1.6562	982.0	13748	8.4493
1.6119	983.0	13762	8.4512
1.5294	984.0	13776	8.4362
1.632	985.0	13790	8.4692
1.5564	986.0	13804	8.4567
1.6513	987.0	13818	8.4790
1.6117	988.0	13832	8.4878
1.6394	989.0	13846	8.4349
1.6707	990.0	13860	8.4176
1.6212	991.0	13874	8.4704
1.5721	992.0	13888	8.4319
1.5873	993.0	13902	8.4356
1.6527	994.0	13916	8.4670
1.6499	995.0	13930	8.4717
1.5975	996.0	13944	8.4682
1.6759	997.0	13958	8.4861
1.5962	998.0	13972	8.4686
1.6465	999.0	13986	8.5004
1.6321	1000.0	14000	8.4563

Framework versions

• Transformers 4.13.0
• Pytorch 1.12.0+cu113
• Datasets 1.16.1
• Tokenizers 0.10.3