kmdb_ner_model

This model is a fine-tuned version of SZTAKI-HLT/hubert-base-cc on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.0324
• Precision: 0.8534
• Recall: 0.8663
• F1: 0.8598
• Accuracy: 0.9888

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0001
• train_batch_size: 4
• eval_batch_size: 4
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 4

Training results

Training Loss	Epoch	Step	Validation Loss	Precision	Recall	F1	Accuracy
0.1602	0.01	100	0.1829	0.3243	0.4688	0.3834	0.9394
0.0987	0.02	200	0.0950	0.4735	0.5440	0.5063	0.9645
0.0798	0.03	300	0.0797	0.5444	0.6213	0.5804	0.9700
0.0621	0.04	400	0.0721	0.6397	0.6657	0.6524	0.9702
0.0755	0.05	500	0.0754	0.3976	0.5034	0.4443	0.9685
0.0652	0.05	600	0.0756	0.4717	0.5575	0.5110	0.9666
0.0469	0.06	700	0.0753	0.6274	0.6476	0.6373	0.9705
0.0611	0.07	800	0.0650	0.6423	0.6597	0.6509	0.9715
0.0683	0.08	900	0.0664	0.5837	0.6236	0.6030	0.9712
0.0465	0.09	1000	0.0654	0.6410	0.6559	0.6483	0.9711
0.0668	0.1	1100	0.0648	0.6061	0.6521	0.6283	0.9713
0.0561	0.11	1200	0.0667	0.4814	0.5733	0.5233	0.9717
0.049	0.12	1300	0.0612	0.6627	0.7160	0.6883	0.9761
0.0619	0.13	1400	0.0602	0.6138	0.6461	0.6296	0.9712
0.0362	0.14	1500	0.0580	0.7041	0.7258	0.7148	0.9769
0.0503	0.15	1600	0.0575	0.5589	0.6311	0.5928	0.9752
0.0521	0.16	1700	0.0594	0.5843	0.6356	0.6089	0.9737
0.0537	0.16	1800	0.0602	0.6281	0.6814	0.6537	0.9758
0.0439	0.17	1900	0.0538	0.6605	0.7280	0.6926	0.9790
0.0376	0.18	2000	0.0553	0.7142	0.7303	0.7221	0.9779
0.0421	0.19	2100	0.0554	0.6985	0.7258	0.7119	0.9780
0.0387	0.2	2200	0.0560	0.7076	0.7145	0.7110	0.9775
0.0548	0.21	2300	0.0559	0.5948	0.6551	0.6235	0.9753
0.0502	0.22	2400	0.0555	0.6095	0.6860	0.6455	0.9768
0.0461	0.23	2500	0.0510	0.6838	0.7100	0.6966	0.9783
0.0482	0.24	2600	0.0559	0.6608	0.7010	0.6803	0.9771
0.0647	0.25	2700	0.0478	0.6293	0.7130	0.6685	0.9797
0.0587	0.26	2800	0.0516	0.6861	0.7175	0.7014	0.9775
0.0618	0.27	2900	0.0566	0.6164	0.7040	0.6573	0.9776
0.0418	0.27	3000	0.0622	0.6069	0.6694	0.6367	0.9714
0.0401	0.28	3100	0.0493	0.6623	0.7205	0.6902	0.9780
0.0488	0.29	3200	0.0531	0.6982	0.7423	0.7196	0.9785
0.0396	0.3	3300	0.0505	0.6872	0.7393	0.7123	0.9795
0.0475	0.31	3400	0.0521	0.7220	0.7415	0.7317	0.9789
0.0455	0.32	3500	0.0566	0.5941	0.6664	0.6282	0.9766
0.0411	0.33	3600	0.0478	0.6477	0.7100	0.6774	0.9791
0.0582	0.34	3700	0.0548	0.6767	0.7092	0.6926	0.9759
0.066	0.35	3800	0.0523	0.6894	0.7355	0.7117	0.9775
0.0309	0.36	3900	0.0472	0.6868	0.7348	0.7100	0.9800
0.0562	0.37	4000	0.0492	0.6776	0.7265	0.7012	0.9782
0.0419	0.38	4100	0.0535	0.6655	0.7130	0.6884	0.9778
0.0459	0.38	4200	0.0433	0.6897	0.7431	0.7154	0.9808
0.047	0.39	4300	0.0481	0.6817	0.7273	0.7037	0.9794
0.0527	0.4	4400	0.0496	0.6165	0.6980	0.6547	0.9788
0.0427	0.41	4500	0.0458	0.6577	0.7175	0.6863	0.9792
0.0597	0.42	4600	0.0446	0.7123	0.7385	0.7252	0.9789
0.0457	0.43	4700	0.0491	0.6816	0.7303	0.7051	0.9795
0.0439	0.44	4800	0.0483	0.6987	0.7438	0.7205	0.9785
0.0488	0.45	4900	0.0495	0.6920	0.7393	0.7149	0.9804
0.0401	0.46	5000	0.0476	0.7116	0.7415	0.7263	0.9790
0.0432	0.47	5100	0.0490	0.6914	0.7220	0.7064	0.9796
0.0572	0.48	5200	0.0459	0.6770	0.7528	0.7129	0.9811
0.0496	0.48	5300	0.0536	0.7123	0.7461	0.7288	0.9781
0.0547	0.49	5400	0.0532	0.6403	0.6942	0.6662	0.9747
0.0509	0.5	5500	0.0499	0.6758	0.7378	0.7055	0.9796
0.0531	0.51	5600	0.0460	0.6980	0.7521	0.7241	0.9813
0.0611	0.52	5700	0.0466	0.644	0.7258	0.6824	0.9804
0.0487	0.53	5800	0.0465	0.6978	0.7513	0.7236	0.9805
0.0339	0.54	5900	0.0489	0.7001	0.7453	0.7220	0.9801
0.04	0.55	6000	0.0475	0.6674	0.7250	0.6950	0.9809
0.0571	0.56	6100	0.0495	0.6787	0.7363	0.7063	0.9806
0.0469	0.57	6200	0.0471	0.7212	0.7423	0.7316	0.9788
0.0371	0.58	6300	0.0531	0.5764	0.6521	0.6119	0.9774
0.0469	0.59	6400	0.0485	0.7135	0.7483	0.7305	0.9789
0.0388	0.59	6500	0.0480	0.7370	0.7370	0.7370	0.9788
0.045	0.6	6600	0.0455	0.6893	0.7385	0.7131	0.9813
0.0456	0.61	6700	0.0530	0.6611	0.6829	0.6718	0.9744
0.0485	0.62	6800	0.0499	0.6855	0.7400	0.7117	0.9797
0.0383	0.63	6900	0.0467	0.7344	0.7603	0.7471	0.9814
0.0424	0.64	7000	0.0445	0.7104	0.7573	0.7331	0.9818
0.0391	0.65	7100	0.0430	0.7576	0.7844	0.7708	0.9823
0.0563	0.66	7200	0.0437	0.7536	0.7791	0.7662	0.9834
0.0509	0.67	7300	0.0442	0.7424	0.7663	0.7542	0.9815
0.0441	0.68	7400	0.0459	0.7101	0.7378	0.7237	0.9797
0.0387	0.69	7500	0.0436	0.7395	0.7528	0.7461	0.9808
0.0397	0.7	7600	0.0450	0.7437	0.7588	0.7512	0.9810
0.0387	0.7	7700	0.0421	0.7436	0.7693	0.7563	0.9817
0.0425	0.71	7800	0.0438	0.7321	0.7761	0.7535	0.9812
0.0361	0.72	7900	0.0463	0.7412	0.7769	0.7586	0.9805
0.0405	0.73	8000	0.0449	0.7603	0.7866	0.7733	0.9825
0.0418	0.74	8100	0.0419	0.7681	0.7986	0.7831	0.9836
0.0333	0.75	8200	0.0437	0.7302	0.7603	0.7449	0.9809
0.0376	0.76	8300	0.0419	0.7600	0.7874	0.7734	0.9830
0.0381	0.77	8400	0.0442	0.7455	0.7701	0.7576	0.9804
0.0355	0.78	8500	0.0434	0.7390	0.7829	0.7603	0.9825
0.0431	0.79	8600	0.0486	0.6938	0.7288	0.7109	0.9791
0.0399	0.8	8700	0.0502	0.7317	0.7724	0.7515	0.9798
0.0533	0.8	8800	0.0441	0.7194	0.7588	0.7386	0.9811
0.0336	0.81	8900	0.0433	0.6454	0.7288	0.6845	0.9803
0.0527	0.82	9000	0.0449	0.75	0.7754	0.7625	0.9823
0.0384	0.83	9100	0.0438	0.7124	0.7573	0.7342	0.9808
0.0362	0.84	9200	0.0442	0.7200	0.7536	0.7364	0.9818
0.0446	0.85	9300	0.0497	0.6768	0.7220	0.6987	0.9778
0.0394	0.86	9400	0.0436	0.7268	0.7536	0.7399	0.9805
0.0467	0.87	9500	0.0464	0.7246	0.7393	0.7319	0.9790
0.0513	0.88	9600	0.0431	0.7207	0.7656	0.7424	0.9816
0.0498	0.89	9700	0.0418	0.7184	0.7724	0.7444	0.9816
0.0323	0.9	9800	0.0445	0.7014	0.7483	0.7241	0.9807
0.0353	0.91	9900	0.0436	0.75	0.7799	0.7646	0.9824
0.0404	0.91	10000	0.0439	0.7415	0.7693	0.7552	0.9803
0.0404	0.92	10100	0.0438	0.7300	0.7596	0.7445	0.9811
0.0355	0.93	10200	0.0423	0.7420	0.7866	0.7637	0.9824
0.0423	0.94	10300	0.0443	0.7292	0.7686	0.7484	0.9804
0.0376	0.95	10400	0.0444	0.7468	0.7844	0.7651	0.9827
0.0351	0.96	10500	0.0395	0.7373	0.7761	0.7562	0.9827
0.0264	0.97	10600	0.0429	0.7487	0.7836	0.7658	0.9814
0.0368	0.98	10700	0.0420	0.6840	0.7415	0.7116	0.9811
0.0318	0.99	10800	0.0399	0.7599	0.7754	0.7676	0.9830
0.0501	1.0	10900	0.0389	0.7393	0.7776	0.7580	0.9823
0.0309	1.01	11000	0.0419	0.7307	0.7806	0.7548	0.9834
0.0402	1.02	11100	0.0378	0.7649	0.8092	0.7864	0.9845
0.0417	1.02	11200	0.0404	0.7570	0.7889	0.7726	0.9837
0.031	1.03	11300	0.0402	0.7428	0.7746	0.7584	0.9819
0.039	1.04	11400	0.0409	0.7460	0.7791	0.7622	0.9822
0.0245	1.05	11500	0.0425	0.744	0.7686	0.7561	0.9816
0.0341	1.06	11600	0.0392	0.7420	0.7821	0.7615	0.9830
0.0359	1.07	11700	0.0422	0.7211	0.7633	0.7416	0.9824
0.0292	1.08	11800	0.0417	0.7457	0.7844	0.7646	0.9829
0.0427	1.09	11900	0.0380	0.7687	0.7889	0.7786	0.9840
0.0465	1.1	12000	0.0393	0.7502	0.7739	0.7618	0.9819
0.0264	1.11	12100	0.0408	0.7417	0.7746	0.7578	0.9823
0.038	1.12	12200	0.0386	0.7737	0.7964	0.7849	0.9839
0.0383	1.13	12300	0.0439	0.7430	0.7754	0.7588	0.9823
0.0324	1.13	12400	0.0401	0.7491	0.7851	0.7667	0.9821
0.0374	1.14	12500	0.0387	0.7836	0.7889	0.7862	0.9834
0.0314	1.15	12600	0.0410	0.7641	0.7934	0.7785	0.9836
0.0343	1.16	12700	0.0430	0.7626	0.7866	0.7744	0.9823
0.0319	1.17	12800	0.0405	0.7450	0.7791	0.7617	0.9830
0.0367	1.18	12900	0.0447	0.7660	0.8017	0.7834	0.9831
0.0347	1.19	13000	0.0409	0.7786	0.7979	0.7881	0.9833
0.0293	1.2	13100	0.0408	0.7686	0.8084	0.7880	0.9839
0.0288	1.21	13200	0.0406	0.7656	0.8002	0.7825	0.9836
0.0409	1.22	13300	0.0424	0.7502	0.7896	0.7694	0.9826
0.0326	1.23	13400	0.0416	0.7952	0.8137	0.8043	0.9843
0.0381	1.23	13500	0.0406	0.7629	0.7761	0.7695	0.9826
0.0343	1.24	13600	0.1198	0.7383	0.7926	0.7645	0.9821
0.0238	1.25	13700	0.0379	0.7778	0.7889	0.7833	0.9835
0.0333	1.26	13800	0.0400	0.7655	0.8047	0.7846	0.9834
0.0423	1.27	13900	0.0425	0.7351	0.7671	0.7507	0.9803
0.0277	1.28	14000	0.0393	0.7766	0.8069	0.7915	0.9837
0.0363	1.29	14100	0.0416	0.7548	0.7724	0.7635	0.9821
0.0286	1.3	14200	0.0425	0.7653	0.7889	0.7769	0.9828
0.0373	1.31	14300	0.0384	0.7738	0.7994	0.7864	0.9844
0.0348	1.32	14400	0.0367	0.7691	0.8032	0.7857	0.9845
0.0394	1.33	14500	0.0362	0.7893	0.8107	0.7999	0.9844
0.0321	1.34	14600	0.0378	0.7908	0.8152	0.8028	0.9846
0.0347	1.34	14700	0.0393	0.7559	0.7979	0.7763	0.9834
0.0317	1.35	14800	0.0388	0.7667	0.8002	0.7831	0.9841
0.0293	1.36	14900	0.0356	0.7889	0.8144	0.8015	0.9852
0.0396	1.37	15000	0.0353	0.7907	0.8174	0.8038	0.9856
0.0342	1.38	15100	0.0390	0.7717	0.7896	0.7805	0.9822
0.0262	1.39	15200	0.0396	0.7325	0.7776	0.7544	0.9827
0.0343	1.4	15300	0.0373	0.7834	0.8069	0.7950	0.9842
0.036	1.41	15400	0.0366	0.7720	0.8039	0.7876	0.9852
0.0355	1.42	15500	0.0479	0.7231	0.7476	0.7351	0.9797
0.037	1.43	15600	0.0372	0.7961	0.8182	0.8070	0.9849
0.0354	1.44	15700	0.0366	0.7852	0.8129	0.7988	0.9837
0.0311	1.45	15800	0.0391	0.7764	0.8009	0.7885	0.9842
0.0375	1.45	15900	0.0378	0.7919	0.8122	0.8019	0.9845
0.031	1.46	16000	0.0378	0.7902	0.8152	0.8025	0.9848
0.0326	1.47	16100	0.0369	0.7969	0.8227	0.8096	0.9846
0.0258	1.48	16200	0.0392	0.7900	0.8167	0.8031	0.9844
0.0238	1.49	16300	0.0430	0.7870	0.8077	0.7972	0.9834
0.0302	1.5	16400	0.0369	0.7980	0.8310	0.8141	0.9854
0.0319	1.51	16500	0.0379	0.8054	0.8242	0.8147	0.9853
0.0275	1.52	16600	0.0369	0.7942	0.8295	0.8115	0.9852
0.0426	1.53	16700	0.0359	0.7865	0.8167	0.8013	0.9848
0.0184	1.54	16800	0.0379	0.7906	0.8227	0.8063	0.9856
0.0334	1.55	16900	0.0369	0.8130	0.8362	0.8244	0.9857
0.0361	1.56	17000	0.0356	0.7847	0.8189	0.8015	0.9851
0.0319	1.56	17100	0.0359	0.7923	0.8197	0.8058	0.9852
0.0336	1.57	17200	0.0383	0.7726	0.8092	0.7905	0.9843
0.03	1.58	17300	0.0384	0.7968	0.8219	0.8092	0.9855
0.0399	1.59	17400	0.0367	0.8074	0.8317	0.8194	0.9860
0.0405	1.6	17500	0.0359	0.8093	0.8227	0.8159	0.9850
0.0262	1.61	17600	0.0388	0.7809	0.8219	0.8009	0.9848
0.0291	1.62	17700	0.0406	0.8071	0.8234	0.8152	0.9850
0.0201	1.63	17800	0.0351	0.8078	0.8272	0.8174	0.9860
0.0269	1.64	17900	0.0386	0.7833	0.8174	0.8000	0.9851
0.0386	1.65	18000	0.0381	0.8141	0.8325	0.8232	0.9860
0.0316	1.66	18100	0.0360	0.7996	0.8242	0.8117	0.9850
0.026	1.66	18200	0.0346	0.8004	0.8347	0.8172	0.9864
0.0356	1.67	18300	0.0336	0.8032	0.8279	0.8154	0.9865
0.0424	1.68	18400	0.0346	0.7896	0.8122	0.8007	0.9849
0.035	1.69	18500	0.0335	0.8084	0.8400	0.8239	0.9863
0.033	1.7	18600	0.0352	0.8069	0.8257	0.8162	0.9858
0.0287	1.71	18700	0.0353	0.8025	0.8242	0.8132	0.9852
0.0341	1.72	18800	0.0347	0.7950	0.8189	0.8068	0.9863
0.0285	1.73	18900	0.0362	0.7945	0.8219	0.8080	0.9850
0.0307	1.74	19000	0.0340	0.8076	0.8422	0.8246	0.9862
0.0227	1.75	19100	0.0363	0.8084	0.8370	0.8224	0.9855
0.0377	1.76	19200	0.0351	0.7922	0.8249	0.8082	0.9849
0.0309	1.77	19300	0.0325	0.808	0.8347	0.8211	0.9869
0.0378	1.77	19400	0.0332	0.8066	0.8272	0.8168	0.9862
0.0353	1.78	19500	0.0335	0.8105	0.8355	0.8228	0.9861
0.0338	1.79	19600	0.0324	0.8026	0.8310	0.8165	0.9864
0.0304	1.8	19700	0.0343	0.8015	0.8189	0.8101	0.9852
0.0359	1.81	19800	0.0351	0.8029	0.8234	0.8131	0.9860
0.0314	1.82	19900	0.0343	0.8045	0.8317	0.8179	0.9857
0.0275	1.83	20000	0.0330	0.8055	0.8340	0.8195	0.9866
0.0352	1.84	20100	0.0338	0.8150	0.8340	0.8244	0.9862
0.0367	1.85	20200	0.0355	0.8050	0.8279	0.8163	0.9852
0.035	1.86	20300	0.0313	0.8224	0.8385	0.8304	0.9876
0.0327	1.87	20400	0.0329	0.8272	0.8415	0.8343	0.9871
0.0339	1.88	20500	0.0326	0.8142	0.8362	0.8251	0.9871
0.0327	1.88	20600	0.0322	0.8242	0.8385	0.8313	0.9872
0.0288	1.89	20700	0.0321	0.8267	0.8460	0.8362	0.9871
0.0423	1.9	20800	0.0313	0.8112	0.8392	0.8250	0.9869
0.0311	1.91	20900	0.0314	0.8245	0.8542	0.8391	0.9870
0.025	1.92	21000	0.0325	0.8218	0.8422	0.8319	0.9864
0.0261	1.93	21100	0.0330	0.8200	0.8452	0.8324	0.9864
0.0382	1.94	21200	0.0334	0.8148	0.8332	0.8239	0.9860
0.0341	1.95	21300	0.0340	0.7906	0.8227	0.8063	0.9857
0.0291	1.96	21400	0.0340	0.8173	0.8370	0.8270	0.9864
0.0387	1.97	21500	0.0336	0.8082	0.8295	0.8187	0.9863
0.032	1.98	21600	0.0338	0.8165	0.8325	0.8244	0.9866
0.0351	1.98	21700	0.0345	0.8073	0.8340	0.8204	0.9866
0.033	1.99	21800	0.0317	0.8047	0.8295	0.8169	0.9866
0.024	2.0	21900	0.0317	0.8244	0.8467	0.8354	0.9871
0.0291	2.01	22000	0.0311	0.8309	0.8490	0.8398	0.9867
0.025	2.02	22100	0.0326	0.8363	0.8482	0.8422	0.9870
0.0238	2.03	22200	0.0325	0.7980	0.8310	0.8141	0.9867
0.022	2.04	22300	0.0328	0.8087	0.8385	0.8233	0.9865
0.0202	2.05	22400	0.0314	0.8007	0.8302	0.8152	0.9860
0.0226	2.06	22500	0.0316	0.8246	0.8407	0.8326	0.9867
0.0326	2.07	22600	0.0359	0.8042	0.8302	0.8170	0.9860
0.0324	2.08	22700	0.0330	0.8135	0.8355	0.8243	0.9864
0.0283	2.09	22800	0.0329	0.8269	0.8467	0.8367	0.9868
0.0206	2.09	22900	0.0330	0.8338	0.8482	0.8410	0.9870
0.0272	2.1	23000	0.0338	0.8202	0.8400	0.8300	0.9864
0.0212	2.11	23100	0.0331	0.8206	0.8385	0.8294	0.9866
0.0238	2.12	23200	0.0339	0.8326	0.8520	0.8422	0.9879
0.025	2.13	23300	0.0328	0.8205	0.8415	0.8309	0.9871
0.0268	2.14	23400	0.0358	0.8164	0.8287	0.8225	0.9864
0.03	2.15	23500	0.0343	0.8233	0.8332	0.8282	0.9862
0.0273	2.16	23600	0.0339	0.8142	0.8362	0.8251	0.9861
0.0209	2.17	23700	0.0359	0.8204	0.8340	0.8271	0.9864
0.0262	2.18	23800	0.0359	0.8170	0.8385	0.8276	0.9866
0.0223	2.19	23900	0.0347	0.8315	0.8490	0.8401	0.9870
0.019	2.2	24000	0.0352	0.8203	0.8302	0.8252	0.9863
0.0308	2.2	24100	0.0321	0.8303	0.8452	0.8377	0.9871
0.0244	2.21	24200	0.0323	0.8103	0.8249	0.8176	0.9868
0.0255	2.22	24300	0.0337	0.8315	0.8452	0.8383	0.9869
0.0304	2.23	24400	0.0328	0.8138	0.8407	0.8271	0.9863
0.0328	2.24	24500	0.0350	0.8107	0.8332	0.8218	0.9861
0.0235	2.25	24600	0.0313	0.8380	0.8512	0.8446	0.9873
0.0203	2.26	24700	0.0349	0.8159	0.8422	0.8288	0.9864
0.0243	2.27	24800	0.0337	0.8216	0.8340	0.8277	0.9862
0.0222	2.28	24900	0.0328	0.8144	0.8437	0.8288	0.9866
0.0279	2.29	25000	0.0345	0.7971	0.8204	0.8086	0.9855
0.0225	2.3	25100	0.0341	0.8168	0.8377	0.8272	0.9864
0.0228	2.31	25200	0.0339	0.8080	0.8317	0.8197	0.9860
0.0279	2.31	25300	0.0333	0.8202	0.8430	0.8314	0.9867
0.0146	2.32	25400	0.0378	0.8123	0.8355	0.8237	0.9851
0.0215	2.33	25500	0.0350	0.8197	0.8437	0.8315	0.9858
0.0237	2.34	25600	0.0326	0.8312	0.8475	0.8393	0.9876
0.0291	2.35	25700	0.0327	0.8214	0.8430	0.8320	0.9870
0.026	2.36	25800	0.0344	0.8200	0.8422	0.8310	0.9867
0.0261	2.37	25900	0.0343	0.8165	0.8392	0.8277	0.9864
0.0268	2.38	26000	0.0356	0.8162	0.8310	0.8235	0.9863
0.0262	2.39	26100	0.0352	0.8263	0.8400	0.8331	0.9861
0.0202	2.4	26200	0.0347	0.8228	0.8475	0.8349	0.9867
0.0307	2.41	26300	0.0332	0.8288	0.8437	0.8362	0.9867
0.0253	2.41	26400	0.0325	0.8322	0.8497	0.8409	0.9875
0.0318	2.42	26500	0.0324	0.8236	0.8385	0.8310	0.9866
0.0216	2.43	26600	0.0326	0.8369	0.8482	0.8425	0.9872
0.0241	2.44	26700	0.0326	0.8292	0.8460	0.8375	0.9865
0.0226	2.45	26800	0.0321	0.8341	0.8535	0.8437	0.9879
0.0229	2.46	26900	0.0352	0.8136	0.8295	0.8214	0.9860
0.029	2.47	27000	0.0323	0.8395	0.8527	0.8461	0.9875
0.0197	2.48	27100	0.0341	0.8216	0.8407	0.8310	0.9864
0.0175	2.49	27200	0.0349	0.8237	0.8392	0.8314	0.9865
0.0193	2.5	27300	0.0325	0.8322	0.8460	0.8390	0.9872
0.0292	2.51	27400	0.0325	0.8255	0.8422	0.8338	0.9867
0.0217	2.52	27500	0.0344	0.8328	0.8460	0.8394	0.9872
0.0249	2.52	27600	0.0328	0.8269	0.8467	0.8367	0.9876
0.0277	2.53	27700	0.0307	0.8416	0.8542	0.8479	0.9876
0.0285	2.54	27800	0.0311	0.8201	0.8460	0.8328	0.9871
0.0238	2.55	27900	0.0306	0.8305	0.8467	0.8385	0.9870
0.0261	2.56	28000	0.0326	0.8300	0.8475	0.8387	0.9873
0.0258	2.57	28100	0.0319	0.8323	0.8467	0.8395	0.9872
0.0208	2.58	28200	0.0322	0.8259	0.8482	0.8369	0.9875
0.0191	2.59	28300	0.0337	0.8230	0.8385	0.8307	0.9867
0.0254	2.6	28400	0.0308	0.8385	0.8505	0.8445	0.9878
0.0283	2.61	28500	0.0313	0.8273	0.8422	0.8347	0.9876
0.032	2.62	28600	0.0311	0.8293	0.8430	0.8361	0.9879
0.0175	2.63	28700	0.0326	0.8363	0.8557	0.8459	0.9877
0.0298	2.63	28800	0.0315	0.8396	0.8535	0.8465	0.9882
0.0156	2.64	28900	0.0305	0.8337	0.8512	0.8424	0.9880
0.0185	2.65	29000	0.0327	0.8320	0.8445	0.8382	0.9873
0.0259	2.66	29100	0.0313	0.8198	0.8407	0.8301	0.9872
0.019	2.67	29200	0.0306	0.8336	0.8430	0.8383	0.9875
0.0301	2.68	29300	0.0315	0.8211	0.8377	0.8293	0.9872
0.0294	2.69	29400	0.0308	0.8277	0.8407	0.8341	0.9875
0.0261	2.7	29500	0.0320	0.8234	0.8445	0.8338	0.9873
0.0373	2.71	29600	0.0295	0.8366	0.8542	0.8454	0.9879
0.0168	2.72	29700	0.0308	0.8284	0.8452	0.8367	0.9874
0.0316	2.73	29800	0.0319	0.8429	0.8505	0.8467	0.9876
0.0241	2.74	29900	0.0311	0.8208	0.8362	0.8284	0.9869
0.0237	2.74	30000	0.0302	0.8359	0.8497	0.8428	0.9880
0.0268	2.75	30100	0.0318	0.8310	0.8497	0.8403	0.9871
0.0206	2.76	30200	0.0325	0.8290	0.8452	0.8371	0.9869
0.022	2.77	30300	0.0329	0.8277	0.8407	0.8341	0.9872
0.0209	2.78	30400	0.0324	0.8174	0.8340	0.8256	0.9871
0.0241	2.79	30500	0.0313	0.8163	0.8347	0.8254	0.9870
0.0287	2.8	30600	0.0312	0.8217	0.8377	0.8296	0.9869
0.0208	2.81	30700	0.0316	0.8338	0.8482	0.8410	0.9873
0.0199	2.82	30800	0.0317	0.8231	0.8422	0.8325	0.9871
0.021	2.83	30900	0.0317	0.8266	0.8490	0.8377	0.9870
0.0206	2.84	31000	0.0311	0.8459	0.8618	0.8537	0.9884
0.0206	2.84	31100	0.0313	0.8298	0.8422	0.8359	0.9866
0.018	2.85	31200	0.0307	0.8332	0.8520	0.8425	0.9876
0.0221	2.86	31300	0.0322	0.8358	0.8452	0.8405	0.9873
0.0224	2.87	31400	0.0304	0.8353	0.8497	0.8425	0.9872
0.0251	2.88	31500	0.0295	0.8354	0.8505	0.8429	0.9877
0.0267	2.89	31600	0.0345	0.8167	0.8370	0.8267	0.9861
0.0212	2.9	31700	0.0306	0.8374	0.8550	0.8461	0.9876
0.0233	2.91	31800	0.0306	0.8401	0.8527	0.8464	0.9872
0.0133	2.92	31900	0.0295	0.8438	0.8565	0.8501	0.9880
0.0167	2.93	32000	0.0303	0.8292	0.8497	0.8393	0.9870
0.0229	2.94	32100	0.0294	0.8327	0.8565	0.8444	0.9876
0.0323	2.95	32200	0.0314	0.8379	0.8467	0.8423	0.9867
0.0206	2.95	32300	0.0306	0.8503	0.8580	0.8542	0.9883
0.0275	2.96	32400	0.0288	0.8498	0.8588	0.8543	0.9884
0.023	2.97	32500	0.0290	0.8383	0.8452	0.8418	0.9869
0.0215	2.98	32600	0.0300	0.8375	0.8482	0.8429	0.9874
0.0228	2.99	32700	0.0294	0.8407	0.8565	0.8485	0.9878
0.0257	3.0	32800	0.0293	0.8458	0.8573	0.8515	0.9881
0.0107	3.01	32900	0.0307	0.8474	0.8595	0.8534	0.9882
0.0112	3.02	33000	0.0314	0.8442	0.8550	0.8496	0.9879
0.0101	3.03	33100	0.0314	0.8513	0.8648	0.8580	0.9886
0.0187	3.04	33200	0.0314	0.8500	0.8603	0.8551	0.9881
0.0125	3.05	33300	0.0323	0.8534	0.8663	0.8598	0.9886
0.0183	3.06	33400	0.0324	0.8541	0.8618	0.8579	0.9884
0.0205	3.06	33500	0.0323	0.8275	0.8505	0.8388	0.9874
0.0118	3.07	33600	0.0320	0.8450	0.8557	0.8503	0.9880
0.0218	3.08	33700	0.0307	0.8463	0.8603	0.8532	0.9886
0.0133	3.09	33800	0.0331	0.8456	0.8603	0.8529	0.9883
0.008	3.1	33900	0.0330	0.8406	0.8557	0.8481	0.9879
0.0171	3.11	34000	0.0327	0.8344	0.8520	0.8431	0.9876
0.0196	3.12	34100	0.0346	0.8400	0.8557	0.8478	0.9873
0.0238	3.13	34200	0.0335	0.8438	0.8603	0.8519	0.9879
0.0144	3.14	34300	0.0323	0.8416	0.8580	0.8497	0.9880
0.013	3.15	34400	0.0326	0.8421	0.8573	0.8496	0.9884
0.0114	3.16	34500	0.0335	0.8399	0.8512	0.8455	0.9873
0.0156	3.17	34600	0.0318	0.8455	0.8550	0.8502	0.9880
0.0139	3.17	34700	0.0338	0.8341	0.8497	0.8418	0.9875
0.0165	3.18	34800	0.0326	0.8516	0.8625	0.8570	0.9885
0.0136	3.19	34900	0.0311	0.8468	0.8557	0.8513	0.9885
0.0158	3.2	35000	0.0323	0.8420	0.8527	0.8473	0.9876
0.0141	3.21	35100	0.0340	0.8360	0.8505	0.8432	0.9872
0.0112	3.22	35200	0.0333	0.8363	0.8520	0.8441	0.9872
0.007	3.23	35300	0.0337	0.8296	0.8452	0.8374	0.9868
0.0204	3.24	35400	0.0333	0.8278	0.8415	0.8346	0.9861
0.0097	3.25	35500	0.0348	0.8236	0.8385	0.8310	0.9861
0.0159	3.26	35600	0.0346	0.8271	0.8407	0.8338	0.9862
0.0134	3.27	35700	0.0348	0.8246	0.8407	0.8326	0.9862
0.0112	3.27	35800	0.0341	0.8362	0.8437	0.8399	0.9863
0.0238	3.28	35900	0.0333	0.8361	0.8430	0.8395	0.9867
0.014	3.29	36000	0.0371	0.8248	0.8347	0.8297	0.9858
0.021	3.3	36100	0.0341	0.8351	0.8445	0.8397	0.9870
0.0129	3.31	36200	0.0367	0.8377	0.8452	0.8414	0.9865
0.0228	3.32	36300	0.0349	0.8388	0.8482	0.8435	0.9873
0.0142	3.33	36400	0.0352	0.8295	0.8407	0.8351	0.9863
0.019	3.34	36500	0.0332	0.8423	0.8505	0.8464	0.9871
0.0199	3.35	36600	0.0338	0.8404	0.8467	0.8436	0.9873
0.0125	3.36	36700	0.0335	0.8407	0.8527	0.8467	0.9878
0.0169	3.37	36800	0.0344	0.8448	0.8505	0.8476	0.9872
0.0114	3.38	36900	0.0354	0.8437	0.8557	0.8497	0.9875
0.0149	3.38	37000	0.0350	0.8296	0.8415	0.8355	0.9863
0.013	3.39	37100	0.0334	0.8411	0.8550	0.8480	0.9873
0.0149	3.4	37200	0.0359	0.8380	0.8475	0.8427	0.9861
0.0103	3.41	37300	0.0335	0.8415	0.8497	0.8456	0.9868
0.016	3.42	37400	0.0333	0.8369	0.8520	0.8444	0.9876
0.0221	3.43	37500	0.0333	0.8251	0.8400	0.8325	0.9867
0.0191	3.44	37600	0.0328	0.8363	0.8482	0.8422	0.9871
0.0132	3.45	37700	0.0327	0.8384	0.8497	0.8440	0.9869
0.0154	3.46	37800	0.0335	0.8401	0.8490	0.8445	0.9869
0.0166	3.47	37900	0.0359	0.8382	0.8445	0.8413	0.9866
0.0149	3.48	38000	0.0336	0.8393	0.8595	0.8493	0.9875
0.014	3.49	38100	0.0330	0.8484	0.8580	0.8532	0.9879
0.0176	3.49	38200	0.0344	0.8441	0.8542	0.8491	0.9875
0.013	3.5	38300	0.0334	0.8513	0.8603	0.8558	0.9884
0.0137	3.51	38400	0.0328	0.8497	0.8580	0.8538	0.9882
0.0117	3.52	38500	0.0335	0.8539	0.8648	0.8593	0.9886
0.0161	3.53	38600	0.0324	0.8571	0.8655	0.8613	0.9886
0.0191	3.54	38700	0.0330	0.8483	0.8610	0.8546	0.9884
0.0188	3.55	38800	0.0325	0.8493	0.8595	0.8544	0.9882
0.0174	3.56	38900	0.0319	0.8576	0.8685	0.8630	0.9889
0.0171	3.57	39000	0.0313	0.8494	0.8603	0.8548	0.9885
0.0217	3.58	39100	0.0311	0.8507	0.8603	0.8554	0.9884
0.0166	3.59	39200	0.0317	0.8532	0.8648	0.8590	0.9886
0.0175	3.59	39300	0.0325	0.8490	0.8618	0.8553	0.9884
0.0182	3.6	39400	0.0330	0.8497	0.8580	0.8538	0.9882
0.0138	3.61	39500	0.0322	0.8387	0.8557	0.8472	0.9879
0.0128	3.62	39600	0.0325	0.8490	0.8573	0.8531	0.9879
0.0173	3.63	39700	0.0336	0.8427	0.8573	0.8499	0.9881
0.0154	3.64	39800	0.0342	0.8496	0.8618	0.8557	0.9882
0.0119	3.65	39900	0.0337	0.8448	0.8588	0.8517	0.9877
0.0145	3.66	40000	0.0355	0.8470	0.8565	0.8517	0.9876
0.0101	3.67	40100	0.0339	0.8505	0.8633	0.8568	0.9885
0.0159	3.68	40200	0.0352	0.8531	0.8640	0.8585	0.9881
0.0216	3.69	40300	0.0334	0.8485	0.8625	0.8554	0.9882
0.0108	3.7	40400	0.0325	0.8479	0.8625	0.8551	0.9880
0.0086	3.7	40500	0.0324	0.8467	0.8633	0.8549	0.9882
0.0161	3.71	40600	0.0334	0.8513	0.8603	0.8558	0.9879
0.0224	3.72	40700	0.0325	0.8536	0.8633	0.8584	0.9882
0.0139	3.73	40800	0.0321	0.8536	0.8670	0.8602	0.9884
0.0181	3.74	40900	0.0328	0.8510	0.8625	0.8567	0.9881
0.0161	3.75	41000	0.0326	0.8542	0.8670	0.8606	0.9883
0.0205	3.76	41100	0.0332	0.8504	0.8588	0.8546	0.9881
0.0093	3.77	41200	0.0338	0.8483	0.8610	0.8546	0.9880
0.0197	3.78	41300	0.0334	0.8535	0.8625	0.8580	0.9881
0.0183	3.79	41400	0.0332	0.8503	0.8618	0.8560	0.9881
0.0169	3.8	41500	0.0327	0.8469	0.8603	0.8535	0.9879
0.0141	3.81	41600	0.0344	0.8489	0.8610	0.8549	0.9879
0.0126	3.81	41700	0.0334	0.8483	0.8610	0.8546	0.9882
0.0181	3.82	41800	0.0333	0.8504	0.8625	0.8564	0.9884
0.0155	3.83	41900	0.0344	0.8506	0.8640	0.8572	0.9881
0.0111	3.84	42000	0.0333	0.8526	0.8648	0.8586	0.9881
0.0169	3.85	42100	0.0339	0.8555	0.8633	0.8594	0.9882
0.0133	3.86	42200	0.0345	0.8565	0.8655	0.8610	0.9881
0.0143	3.87	42300	0.0342	0.8545	0.8648	0.8596	0.9884
0.0144	3.88	42400	0.0323	0.8522	0.8663	0.8592	0.9886
0.0123	3.89	42500	0.0329	0.8532	0.8648	0.8590	0.9885
0.0146	3.9	42600	0.0324	0.8514	0.8655	0.8584	0.9888
0.0107	3.91	42700	0.0327	0.8517	0.8670	0.8593	0.9888
0.0165	3.92	42800	0.0328	0.8530	0.8633	0.8581	0.9887
0.0161	3.92	42900	0.0331	0.8470	0.8610	0.8539	0.9886
0.0089	3.93	43000	0.0330	0.8496	0.8618	0.8557	0.9886
0.0139	3.94	43100	0.0329	0.8438	0.8603	0.8519	0.9884
0.0091	3.95	43200	0.0322	0.8562	0.8678	0.8619	0.9888
0.0174	3.96	43300	0.0324	0.8576	0.8685	0.8630	0.9889
0.0142	3.97	43400	0.0324	0.8548	0.8670	0.8609	0.9889
0.0126	3.98	43500	0.0323	0.8541	0.8663	0.8601	0.9887
0.019	3.99	43600	0.0323	0.8541	0.8663	0.8601	0.9887
0.011	4.0	43700	0.0324	0.8534	0.8663	0.8598	0.9888

Framework versions

• Transformers 4.38.1
• Pytorch 2.0.1+cu117
• Datasets 2.16.1
• Tokenizers 0.15.0