nerugm-pt-pl50-2

This model is a fine-tuned version of indolem/indobert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.1965
• Location Precision: 0.7792
• Location Recall: 0.8333
• Location F1: 0.8054
• Location Number: 72
• Organization Precision: 0.7191
• Organization Recall: 0.8533
• Organization F1: 0.7805
• Organization Number: 75
• Person Precision: 0.8654
• Person Recall: 0.9441
• Person F1: 0.9030
• Person Number: 143
• Quantity Precision: 0.6429
• Quantity Recall: 0.7826
• Quantity F1: 0.7059
• Quantity Number: 23
• Time Precision: 0.7241
• Time Recall: 0.8077
• Time F1: 0.7636
• Time Number: 26
• Overall Precision: 0.7863
• Overall Recall: 0.8791
• Overall F1: 0.8301
• Overall Accuracy: 0.9607

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 16
• eval_batch_size: 64
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100.0

Training results

Training Loss	Epoch	Step	Validation Loss	Location Precision	Location Recall	Location F1	Location Number	Organization Precision	Organization Recall	Organization F1	Organization Number	Person Precision	Person Recall	Person F1	Person Number	Quantity Precision	Quantity Recall	Quantity F1	Quantity Number	Time Precision	Time Recall	Time F1	Time Number	Overall Precision	Overall Recall	Overall F1	Overall Accuracy
0.9684	1.0	106	0.5552	0.0	0.0	0.0	72	0.0	0.0	0.0	75	0.2667	0.0280	0.0506	143	0.0	0.0	0.0	23	0.0	0.0	0.0	26	0.16	0.0118	0.0220	0.8481
0.4768	2.0	212	0.3080	0.4412	0.4167	0.4286	72	0.2041	0.1333	0.1613	75	0.4410	0.7063	0.5430	143	0.2593	0.3043	0.2800	23	0.6552	0.7308	0.6909	26	0.4154	0.4926	0.4507	0.9067
0.2841	3.0	318	0.2019	0.5833	0.6806	0.6282	72	0.5044	0.76	0.6064	75	0.7529	0.9161	0.8265	143	0.3902	0.6957	0.5000	23	0.7	0.8077	0.75	26	0.6199	0.8083	0.7017	0.9362
0.2019	4.0	424	0.1979	0.6512	0.7778	0.7089	72	0.51	0.68	0.5829	75	0.7542	0.9441	0.8385	143	0.4634	0.8261	0.5938	23	0.5833	0.8077	0.6774	26	0.6380	0.8319	0.7222	0.9337
0.1719	5.0	530	0.1445	0.7692	0.8333	0.8	72	0.6	0.76	0.6706	75	0.8428	0.9371	0.8874	143	0.5143	0.7826	0.6207	23	0.7241	0.8077	0.7636	26	0.7323	0.8555	0.7891	0.9510
0.1574	6.0	636	0.1488	0.6667	0.8056	0.7296	72	0.5565	0.8533	0.6737	75	0.8282	0.9441	0.8824	143	0.6452	0.8696	0.7407	23	0.6774	0.8077	0.7368	26	0.6979	0.8791	0.7781	0.9480
0.1454	7.0	742	0.1420	0.7468	0.8194	0.7815	72	0.5980	0.8133	0.6893	75	0.8395	0.9510	0.8918	143	0.5758	0.8261	0.6786	23	0.6562	0.8077	0.7241	26	0.7255	0.8732	0.7925	0.9515
0.1366	8.0	848	0.1407	0.7595	0.8333	0.7947	72	0.6058	0.84	0.7039	75	0.8447	0.9510	0.8947	143	0.5455	0.7826	0.6429	23	0.6061	0.7692	0.6780	26	0.7244	0.8761	0.7931	0.9537
0.1301	9.0	954	0.1434	0.7195	0.8194	0.7662	72	0.6452	0.8	0.7143	75	0.8782	0.9580	0.9164	143	0.6452	0.8696	0.7407	23	0.5882	0.7692	0.6667	26	0.7475	0.8732	0.8054	0.9547
0.1224	10.0	1060	0.1341	0.8219	0.8333	0.8276	72	0.6517	0.7733	0.7073	75	0.8616	0.9580	0.9073	143	0.5625	0.7826	0.6545	23	0.625	0.7692	0.6897	26	0.7610	0.8643	0.8094	0.9565
0.1156	11.0	1166	0.1326	0.7407	0.8333	0.7843	72	0.6042	0.7733	0.6784	75	0.8710	0.9441	0.9060	143	0.6061	0.8696	0.7143	23	0.7097	0.8462	0.7719	26	0.7449	0.8702	0.8027	0.9550
0.1144	12.0	1272	0.1354	0.8	0.8333	0.8163	72	0.6667	0.8	0.7273	75	0.8654	0.9441	0.9030	143	0.5938	0.8261	0.6909	23	0.8214	0.8846	0.8519	26	0.7795	0.8761	0.825	0.9572
0.1063	13.0	1378	0.1414	0.7973	0.8194	0.8082	72	0.6923	0.84	0.7590	75	0.8679	0.9650	0.9139	143	0.6552	0.8261	0.7308	23	0.7097	0.8462	0.7719	26	0.7839	0.8879	0.8326	0.9577
0.1054	14.0	1484	0.1361	0.7922	0.8472	0.8188	72	0.6505	0.8933	0.7528	75	0.8662	0.9510	0.9067	143	0.6129	0.8261	0.7037	23	0.7333	0.8462	0.7857	26	0.7663	0.8997	0.8277	0.9575
0.1044	15.0	1590	0.1340	0.8056	0.8056	0.8056	72	0.6337	0.8533	0.7273	75	0.8831	0.9510	0.9158	143	0.6207	0.7826	0.6923	23	0.7586	0.8462	0.8	26	0.7740	0.8791	0.8232	0.9570
0.0948	16.0	1696	0.1480	0.7531	0.8472	0.7974	72	0.5982	0.8933	0.7166	75	0.8375	0.9371	0.8845	143	0.6129	0.8261	0.7037	23	0.7241	0.8077	0.7636	26	0.7312	0.8909	0.8032	0.9512
0.0901	17.0	1802	0.1360	0.7439	0.8472	0.7922	72	0.6737	0.8533	0.7529	75	0.8616	0.9580	0.9073	143	0.6333	0.8261	0.7170	23	0.7586	0.8462	0.8	26	0.7671	0.8938	0.8256	0.9570
0.0919	18.0	1908	0.1312	0.8	0.8333	0.8163	72	0.7033	0.8533	0.7711	75	0.8718	0.9510	0.9097	143	0.5625	0.7826	0.6545	23	0.7	0.8077	0.75	26	0.7786	0.8820	0.8271	0.9602
0.0881	19.0	2014	0.1337	0.8	0.8333	0.8163	72	0.6939	0.9067	0.7861	75	0.8654	0.9441	0.9030	143	0.6552	0.8261	0.7308	23	0.8214	0.8846	0.8519	26	0.7902	0.8997	0.8414	0.9605
0.084	20.0	2120	0.1626	0.7595	0.8333	0.7947	72	0.6132	0.8667	0.7182	75	0.8375	0.9371	0.8845	143	0.6207	0.7826	0.6923	23	0.6774	0.8077	0.7368	26	0.7358	0.8791	0.8011	0.9497
0.0814	21.0	2226	0.1468	0.7792	0.8333	0.8054	72	0.7111	0.8533	0.7758	75	0.8562	0.9580	0.9043	143	0.6786	0.8261	0.7451	23	0.7857	0.8462	0.8148	26	0.7885	0.8909	0.8366	0.9577
0.0801	22.0	2332	0.1516	0.7692	0.8333	0.8	72	0.6204	0.8933	0.7322	75	0.8710	0.9441	0.9060	143	0.6	0.7826	0.6792	23	0.7333	0.8462	0.7857	26	0.7531	0.8909	0.8162	0.9540
0.0791	23.0	2438	0.1466	0.7867	0.8194	0.8027	72	0.7053	0.8933	0.7882	75	0.8375	0.9371	0.8845	143	0.6667	0.8696	0.7547	23	0.7097	0.8462	0.7719	26	0.7724	0.8909	0.8274	0.9590
0.0756	24.0	2544	0.1411	0.775	0.8611	0.8158	72	0.7273	0.8533	0.7853	75	0.8438	0.9441	0.8911	143	0.7143	0.8696	0.7843	23	0.6774	0.8077	0.7368	26	0.7804	0.8909	0.8320	0.9590
0.073	25.0	2650	0.1460	0.7875	0.875	0.8289	72	0.6635	0.92	0.7709	75	0.8671	0.9580	0.9103	143	0.6	0.7826	0.6792	23	0.6774	0.8077	0.7368	26	0.7643	0.9086	0.8302	0.9570
0.0704	26.0	2756	0.1478	0.7625	0.8472	0.8026	72	0.7010	0.9067	0.7907	75	0.8599	0.9441	0.9	143	0.6552	0.8261	0.7308	23	0.7333	0.8462	0.7857	26	0.7761	0.8997	0.8333	0.9577
0.0676	27.0	2862	0.1579	0.7531	0.8472	0.7974	72	0.7033	0.8533	0.7711	75	0.8385	0.9441	0.8882	143	0.6552	0.8261	0.7308	23	0.7097	0.8462	0.7719	26	0.7659	0.8879	0.8224	0.9567
0.0691	28.0	2968	0.1352	0.8026	0.8472	0.8243	72	0.7159	0.84	0.7730	75	0.8599	0.9441	0.9	143	0.6429	0.7826	0.7059	23	0.7333	0.8462	0.7857	26	0.7889	0.8820	0.8329	0.9605
0.0665	29.0	3074	0.1470	0.8052	0.8611	0.8322	72	0.6765	0.92	0.7797	75	0.8718	0.9510	0.9097	143	0.5806	0.7826	0.6667	23	0.6875	0.8462	0.7586	26	0.7714	0.9056	0.8331	0.9567
0.0654	30.0	3180	0.1369	0.7209	0.8611	0.7848	72	0.7283	0.8933	0.8024	75	0.8662	0.9510	0.9067	143	0.6207	0.7826	0.6923	23	0.7586	0.8462	0.8	26	0.7761	0.8997	0.8333	0.9610
0.0636	31.0	3286	0.1499	0.8026	0.8472	0.8243	72	0.6505	0.8933	0.7528	75	0.8671	0.9580	0.9103	143	0.6786	0.8261	0.7451	23	0.7931	0.8846	0.8364	26	0.7792	0.9056	0.8377	0.9572
0.0603	32.0	3392	0.1324	0.8289	0.875	0.8514	72	0.6790	0.7333	0.7051	75	0.8831	0.9510	0.9158	143	0.6552	0.8261	0.7308	23	0.7692	0.7692	0.7692	26	0.8005	0.8643	0.8312	0.9612
0.0618	33.0	3498	0.1569	0.8133	0.8472	0.8299	72	0.6667	0.9067	0.7684	75	0.8782	0.9580	0.9164	143	0.6552	0.8261	0.7308	23	0.7097	0.8462	0.7719	26	0.7812	0.9056	0.8388	0.9590
0.0593	34.0	3604	0.1743	0.7683	0.875	0.8182	72	0.6471	0.88	0.7458	75	0.8671	0.9580	0.9103	143	0.6207	0.7826	0.6923	23	0.7419	0.8846	0.8070	26	0.7637	0.9056	0.8286	0.9540
0.0591	35.0	3710	0.1457	0.7805	0.8889	0.8312	72	0.7273	0.8533	0.7853	75	0.8662	0.9510	0.9067	143	0.6429	0.7826	0.7059	23	0.7586	0.8462	0.8	26	0.7917	0.8968	0.8409	0.9597
0.0574	36.0	3816	0.1513	0.7821	0.8472	0.8133	72	0.6907	0.8933	0.7791	75	0.85	0.9510	0.8977	143	0.7037	0.8261	0.76	23	0.7097	0.8462	0.7719	26	0.7761	0.8997	0.8333	0.9582
0.0572	37.0	3922	0.1482	0.8052	0.8611	0.8322	72	0.7386	0.8667	0.7975	75	0.8599	0.9441	0.9	143	0.7037	0.8261	0.76	23	0.8214	0.8846	0.8519	26	0.8064	0.8968	0.8492	0.9620
0.0566	38.0	4028	0.1489	0.8052	0.8611	0.8322	72	0.7444	0.8933	0.8121	75	0.8734	0.9650	0.9169	143	0.7037	0.8261	0.76	23	0.7333	0.8462	0.7857	26	0.8063	0.9086	0.8544	0.9620
0.0516	39.0	4134	0.1653	0.7922	0.8472	0.8188	72	0.6768	0.8933	0.7701	75	0.8385	0.9441	0.8882	143	0.7037	0.8261	0.76	23	0.7586	0.8462	0.8	26	0.7735	0.8968	0.8306	0.9560
0.0533	40.0	4240	0.1632	0.7973	0.8194	0.8082	72	0.7222	0.8667	0.7879	75	0.85	0.9510	0.8977	143	0.7037	0.8261	0.76	23	0.7097	0.8462	0.7719	26	0.7880	0.8879	0.8350	0.9605
0.0511	41.0	4346	0.1624	0.75	0.875	0.8077	72	0.6699	0.92	0.7753	75	0.8616	0.9580	0.9073	143	0.76	0.8261	0.7917	23	0.7097	0.8462	0.7719	26	0.7711	0.9145	0.8367	0.9572
0.0494	42.0	4452	0.1607	0.7821	0.8472	0.8133	72	0.7841	0.92	0.8466	75	0.8726	0.9580	0.9133	143	0.7308	0.8261	0.7755	23	0.7667	0.8846	0.8214	26	0.8153	0.9115	0.8607	0.9635
0.0486	43.0	4558	0.1478	0.8108	0.8333	0.8219	72	0.7674	0.88	0.8199	75	0.8608	0.9510	0.9037	143	0.6923	0.7826	0.7347	23	0.8148	0.8462	0.8302	26	0.8140	0.8909	0.8507	0.9632
0.0506	44.0	4664	0.1482	0.8026	0.8472	0.8243	72	0.7241	0.84	0.7778	75	0.8846	0.9650	0.9231	143	0.6667	0.7826	0.72	23	0.6667	0.8462	0.7458	26	0.7968	0.8909	0.8412	0.9620
0.0486	45.0	4770	0.1589	0.7949	0.8611	0.8267	72	0.67	0.8933	0.7657	75	0.8662	0.9510	0.9067	143	0.6667	0.7826	0.72	23	0.7333	0.8462	0.7857	26	0.7781	0.8997	0.8345	0.9595
0.0467	46.0	4876	0.1617	0.7692	0.8333	0.8	72	0.7381	0.8267	0.7799	75	0.8553	0.9510	0.9007	143	0.6296	0.7391	0.68	23	0.7097	0.8462	0.7719	26	0.7836	0.8761	0.8273	0.9610
0.0475	47.0	4982	0.1676	0.7792	0.8333	0.8054	72	0.7386	0.8667	0.7975	75	0.8718	0.9510	0.9097	143	0.6429	0.7826	0.7059	23	0.7419	0.8846	0.8070	26	0.7947	0.8909	0.8401	0.9600
0.0429	48.0	5088	0.1693	0.7821	0.8472	0.8133	72	0.7447	0.9333	0.8284	75	0.8679	0.9650	0.9139	143	0.6	0.7826	0.6792	23	0.7097	0.8462	0.7719	26	0.7883	0.9115	0.8454	0.9600
0.042	49.0	5194	0.1739	0.7654	0.8611	0.8105	72	0.7030	0.9467	0.8068	75	0.8688	0.9720	0.9175	143	0.6129	0.8261	0.7037	23	0.6875	0.8462	0.7586	26	0.7728	0.9233	0.8414	0.9572
0.0427	50.0	5300	0.1647	0.7407	0.8333	0.7843	72	0.7241	0.84	0.7778	75	0.8839	0.9580	0.9195	143	0.6129	0.8261	0.7037	23	0.6875	0.8462	0.7586	26	0.7798	0.8879	0.8303	0.9577
0.0416	51.0	5406	0.1732	0.7792	0.8333	0.8054	72	0.6939	0.9067	0.7861	75	0.8562	0.9580	0.9043	143	0.7037	0.8261	0.76	23	0.7241	0.8077	0.7636	26	0.7801	0.8997	0.8356	0.9597
0.0402	52.0	5512	0.1703	0.7922	0.8472	0.8188	72	0.6939	0.9067	0.7861	75	0.8679	0.9650	0.9139	143	0.6897	0.8696	0.7692	23	0.7586	0.8462	0.8	26	0.7883	0.9115	0.8454	0.9610
0.0397	53.0	5618	0.1782	0.775	0.8611	0.8158	72	0.67	0.8933	0.7657	75	0.8571	0.9650	0.9079	143	0.6552	0.8261	0.7308	23	0.7	0.8077	0.75	26	0.7675	0.9056	0.8309	0.9570
0.0383	54.0	5724	0.1743	0.8356	0.8472	0.8414	72	0.7010	0.9067	0.7907	75	0.8634	0.9720	0.9145	143	0.7037	0.8261	0.76	23	0.7586	0.8462	0.8	26	0.7984	0.9115	0.8512	0.9615
0.0402	55.0	5830	0.1800	0.8026	0.8472	0.8243	72	0.6939	0.9067	0.7861	75	0.8608	0.9510	0.9037	143	0.6552	0.8261	0.7308	23	0.7097	0.8462	0.7719	26	0.7806	0.9027	0.8372	0.9602
0.0373	56.0	5936	0.1748	0.7821	0.8472	0.8133	72	0.7097	0.88	0.7857	75	0.8831	0.9510	0.9158	143	0.7143	0.8696	0.7843	23	0.8148	0.8462	0.8302	26	0.8026	0.8997	0.8484	0.9610
0.038	57.0	6042	0.1710	0.7692	0.8333	0.8	72	0.7065	0.8667	0.7784	75	0.8831	0.9510	0.9158	143	0.6429	0.7826	0.7059	23	0.8148	0.8462	0.8302	26	0.7942	0.8879	0.8384	0.9605
0.0387	58.0	6148	0.1780	0.7692	0.8333	0.8	72	0.7363	0.8933	0.8072	75	0.8608	0.9510	0.9037	143	0.6786	0.8261	0.7451	23	0.7333	0.8462	0.7857	26	0.7896	0.8968	0.8398	0.9612
0.0389	59.0	6254	0.1953	0.7625	0.8472	0.8026	72	0.6481	0.9333	0.7650	75	0.8774	0.9510	0.9128	143	0.6786	0.8261	0.7451	23	0.7586	0.8462	0.8	26	0.77	0.9086	0.8336	0.9552
0.0383	60.0	6360	0.1891	0.8052	0.8611	0.8322	72	0.6731	0.9333	0.7821	75	0.8481	0.9371	0.8904	143	0.6786	0.8261	0.7451	23	0.7586	0.8462	0.8	26	0.7753	0.9056	0.8354	0.9580
0.0366	61.0	6466	0.1952	0.7595	0.8333	0.7947	72	0.6907	0.8933	0.7791	75	0.8616	0.9580	0.9073	143	0.6786	0.8261	0.7451	23	0.7586	0.8462	0.8	26	0.7781	0.8997	0.8345	0.9570
0.0354	62.0	6572	0.1740	0.8108	0.8333	0.8219	72	0.7558	0.8667	0.8075	75	0.8726	0.9580	0.9133	143	0.6667	0.7826	0.72	23	0.75	0.8077	0.7778	26	0.8091	0.8879	0.8467	0.9627
0.0338	63.0	6678	0.1794	0.8026	0.8472	0.8243	72	0.7273	0.8533	0.7853	75	0.8824	0.9441	0.9122	143	0.625	0.8696	0.7273	23	0.7333	0.8462	0.7857	26	0.7968	0.8909	0.8412	0.9605
0.0339	64.0	6784	0.1945	0.7949	0.8611	0.8267	72	0.7253	0.88	0.7952	75	0.8854	0.9720	0.9267	143	0.6452	0.8696	0.7407	23	0.7667	0.8846	0.8214	26	0.8010	0.9145	0.8540	0.9602
0.0344	65.0	6890	0.1901	0.7595	0.8333	0.7947	72	0.7045	0.8267	0.7607	75	0.8365	0.9301	0.8808	143	0.6786	0.8261	0.7451	23	0.7333	0.8462	0.7857	26	0.7708	0.8732	0.8188	0.9565
0.0335	66.0	6996	0.1948	0.8026	0.8472	0.8243	72	0.7174	0.88	0.7904	75	0.8718	0.9510	0.9097	143	0.6429	0.7826	0.7059	23	0.8148	0.8462	0.8302	26	0.7995	0.8938	0.8440	0.9592
0.033	67.0	7102	0.1835	0.8267	0.8611	0.8435	72	0.7556	0.9067	0.8242	75	0.8608	0.9510	0.9037	143	0.6786	0.8261	0.7451	23	0.7333	0.8462	0.7857	26	0.8058	0.9056	0.8528	0.9640
0.03	68.0	7208	0.1935	0.7407	0.8333	0.7843	72	0.7065	0.8667	0.7784	75	0.8718	0.9510	0.9097	143	0.6667	0.7826	0.72	23	0.7586	0.8462	0.8	26	0.7818	0.8879	0.8315	0.9585
0.0304	69.0	7314	0.1900	0.7975	0.875	0.8344	72	0.7614	0.8933	0.8221	75	0.8535	0.9371	0.8933	143	0.6667	0.7826	0.72	23	0.8148	0.8462	0.8302	26	0.8042	0.8968	0.8480	0.9607
0.0311	70.0	7420	0.1906	0.7381	0.8611	0.7949	72	0.7093	0.8133	0.7578	75	0.8718	0.9510	0.9097	143	0.6667	0.8696	0.7547	23	0.6875	0.8462	0.7586	26	0.7758	0.8879	0.8281	0.9590
0.0301	71.0	7526	0.1901	0.7821	0.8472	0.8133	72	0.7253	0.88	0.7952	75	0.8645	0.9371	0.8993	143	0.6786	0.8261	0.7451	23	0.8148	0.8462	0.8302	26	0.7968	0.8909	0.8412	0.9610
0.0302	72.0	7632	0.1992	0.7922	0.8472	0.8188	72	0.7253	0.88	0.7952	75	0.85	0.9510	0.8977	143	0.6333	0.8261	0.7170	23	0.7	0.8077	0.75	26	0.7809	0.8938	0.8336	0.9590
0.032	73.0	7738	0.1827	0.7821	0.8472	0.8133	72	0.7386	0.8667	0.7975	75	0.8636	0.9301	0.8956	143	0.6429	0.7826	0.7059	23	0.75	0.8077	0.7778	26	0.7926	0.8791	0.8336	0.9602
0.0299	74.0	7844	0.1865	0.7595	0.8333	0.7947	72	0.7273	0.8533	0.7853	75	0.8627	0.9231	0.8919	143	0.6786	0.8261	0.7451	23	0.7333	0.8462	0.7857	26	0.7857	0.8761	0.8285	0.9590
0.0276	75.0	7950	0.1954	0.7439	0.8472	0.7922	72	0.75	0.84	0.7925	75	0.8608	0.9510	0.9037	143	0.6552	0.8261	0.7308	23	0.7333	0.8462	0.7857	26	0.7859	0.8879	0.8338	0.9590
0.0284	76.0	8056	0.1914	0.7692	0.8333	0.8	72	0.7010	0.9067	0.7907	75	0.8599	0.9441	0.9	143	0.6429	0.7826	0.7059	23	0.75	0.8077	0.7778	26	0.7784	0.8909	0.8308	0.9590
0.0283	77.0	8162	0.1985	0.7922	0.8472	0.8188	72	0.7158	0.9067	0.8000	75	0.8679	0.9650	0.9139	143	0.6786	0.8261	0.7451	23	0.7097	0.8462	0.7719	26	0.7897	0.9086	0.8450	0.9605
0.0278	78.0	8268	0.1901	0.7692	0.8333	0.8	72	0.7738	0.8667	0.8176	75	0.8654	0.9441	0.9030	143	0.6786	0.8261	0.7451	23	0.7333	0.8462	0.7857	26	0.8005	0.8879	0.8420	0.9620
0.027	79.0	8374	0.1913	0.8026	0.8472	0.8243	72	0.7412	0.84	0.7875	75	0.8590	0.9371	0.8963	143	0.6786	0.8261	0.7451	23	0.7333	0.8462	0.7857	26	0.7973	0.8820	0.8375	0.9620
0.0242	80.0	8480	0.1941	0.8133	0.8472	0.8299	72	0.7273	0.8533	0.7853	75	0.8662	0.9510	0.9067	143	0.6429	0.7826	0.7059	23	0.7241	0.8077	0.7636	26	0.7958	0.8850	0.8380	0.9607
0.0279	81.0	8586	0.1825	0.8133	0.8472	0.8299	72	0.7442	0.8533	0.7950	75	0.8654	0.9441	0.9030	143	0.6667	0.7826	0.72	23	0.7333	0.8462	0.7857	26	0.8021	0.8850	0.8415	0.9630
0.0251	82.0	8692	0.1950	0.7792	0.8333	0.8054	72	0.7444	0.8933	0.8121	75	0.8662	0.9510	0.9067	143	0.6207	0.7826	0.6923	23	0.75	0.8077	0.7778	26	0.7927	0.8909	0.8389	0.9610
0.0276	83.0	8798	0.1903	0.7895	0.8333	0.8108	72	0.7222	0.8667	0.7879	75	0.8766	0.9441	0.9091	143	0.6429	0.7826	0.7059	23	0.7778	0.8077	0.7925	26	0.7973	0.8820	0.8375	0.9612
0.0249	84.0	8904	0.1908	0.8	0.8333	0.8163	72	0.7128	0.8933	0.7929	75	0.8590	0.9371	0.8963	143	0.6667	0.7826	0.72	23	0.7586	0.8462	0.8	26	0.7900	0.8879	0.8361	0.9620
0.0258	85.0	9010	0.1896	0.7792	0.8333	0.8054	72	0.75	0.88	0.8098	75	0.8608	0.9510	0.9037	143	0.6429	0.7826	0.7059	23	0.7333	0.8462	0.7857	26	0.7927	0.8909	0.8389	0.9622
0.025	86.0	9116	0.1914	0.7595	0.8333	0.7947	72	0.7273	0.8533	0.7853	75	0.8599	0.9441	0.9	143	0.6667	0.7826	0.72	23	0.7333	0.8462	0.7857	26	0.7848	0.8820	0.8306	0.9602
0.0249	87.0	9222	0.1874	0.7867	0.8194	0.8027	72	0.7303	0.8667	0.7927	75	0.8590	0.9371	0.8963	143	0.6667	0.7826	0.72	23	0.7333	0.8462	0.7857	26	0.7905	0.8791	0.8324	0.9612
0.0248	88.0	9328	0.2012	0.75	0.8333	0.7895	72	0.6875	0.88	0.7719	75	0.8662	0.9510	0.9067	143	0.6667	0.7826	0.72	23	0.7241	0.8077	0.7636	26	0.7738	0.8879	0.8269	0.9587
0.0257	89.0	9434	0.1883	0.7792	0.8333	0.8054	72	0.7273	0.8533	0.7853	75	0.8599	0.9441	0.9	143	0.6667	0.7826	0.72	23	0.7241	0.8077	0.7636	26	0.7884	0.8791	0.8312	0.9615
0.0244	90.0	9540	0.1961	0.8	0.8333	0.8163	72	0.7111	0.8533	0.7758	75	0.8710	0.9441	0.9060	143	0.6667	0.7826	0.72	23	0.6897	0.7692	0.7273	26	0.7899	0.8761	0.8308	0.9602
0.0251	91.0	9646	0.1901	0.8108	0.8333	0.8219	72	0.7412	0.84	0.7875	75	0.8654	0.9441	0.9030	143	0.6667	0.7826	0.72	23	0.7241	0.8077	0.7636	26	0.8005	0.8761	0.8366	0.9620
0.0259	92.0	9752	0.1910	0.7895	0.8333	0.8108	72	0.7191	0.8533	0.7805	75	0.8654	0.9441	0.9030	143	0.6667	0.7826	0.72	23	0.7241	0.8077	0.7636	26	0.7905	0.8791	0.8324	0.9612
0.0237	93.0	9858	0.1974	0.7692	0.8333	0.8	72	0.7079	0.84	0.7683	75	0.8824	0.9441	0.9122	143	0.6429	0.7826	0.7059	23	0.7241	0.8077	0.7636	26	0.7878	0.8761	0.8296	0.9592
0.0235	94.0	9964	0.1993	0.7792	0.8333	0.8054	72	0.7033	0.8533	0.7711	75	0.8824	0.9441	0.9122	143	0.6	0.7826	0.6792	23	0.7241	0.8077	0.7636	26	0.7842	0.8791	0.8289	0.9585
0.024	95.0	10070	0.1976	0.7692	0.8333	0.8	72	0.7111	0.8533	0.7758	75	0.8701	0.9371	0.9024	143	0.6429	0.7826	0.7059	23	0.7241	0.8077	0.7636	26	0.7836	0.8761	0.8273	0.9595
0.0232	96.0	10176	0.1956	0.7792	0.8333	0.8054	72	0.7191	0.8533	0.7805	75	0.8590	0.9371	0.8963	143	0.6429	0.7826	0.7059	23	0.7241	0.8077	0.7636	26	0.7836	0.8761	0.8273	0.9605
0.0251	97.0	10282	0.1956	0.7792	0.8333	0.8054	72	0.7033	0.8533	0.7711	75	0.8645	0.9371	0.8993	143	0.6429	0.7826	0.7059	23	0.7241	0.8077	0.7636	26	0.7816	0.8761	0.8261	0.9597
0.0229	98.0	10388	0.1946	0.7792	0.8333	0.8054	72	0.7111	0.8533	0.7758	75	0.8654	0.9441	0.9030	143	0.6429	0.7826	0.7059	23	0.7241	0.8077	0.7636	26	0.7842	0.8791	0.8289	0.9605
0.0227	99.0	10494	0.1965	0.7792	0.8333	0.8054	72	0.7111	0.8533	0.7758	75	0.8654	0.9441	0.9030	143	0.6429	0.7826	0.7059	23	0.7241	0.8077	0.7636	26	0.7842	0.8791	0.8289	0.9605
0.0238	100.0	10600	0.1965	0.7792	0.8333	0.8054	72	0.7191	0.8533	0.7805	75	0.8654	0.9441	0.9030	143	0.6429	0.7826	0.7059	23	0.7241	0.8077	0.7636	26	0.7863	0.8791	0.8301	0.9607

Framework versions

• Transformers 4.40.2
• Pytorch 2.3.0+cu121
• Datasets 2.19.1
• Tokenizers 0.19.1