nerui-base-3

This model is a fine-tuned version of indolem/indobert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.1047
• Location Precision: 0.8925
• Location Recall: 0.9651
• Location F1: 0.9274
• Location Number: 86
• Organization Precision: 0.9538
• Organization Recall: 0.9270
• Organization F1: 0.9402
• Organization Number: 178
• Person Precision: 0.9685
• Person Recall: 0.9609
• Person F1: 0.9647
• Person Number: 128
• Overall Precision: 0.9440
• Overall Recall: 0.9464
• Overall F1: 0.9452
• Overall Accuracy: 0.9876

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 16
• eval_batch_size: 64
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100.0

Training results

Training Loss	Epoch	Step	Validation Loss	Location Precision	Location Recall	Location F1	Location Number	Organization Precision	Organization Recall	Organization F1	Organization Number	Person Precision	Person Recall	Person F1	Person Number	Overall Precision	Overall Recall	Overall F1	Overall Accuracy
0.2442	1.0	96	0.0581	0.8384	0.9651	0.8973	86	0.8535	0.9494	0.8989	178	0.9690	0.9766	0.9728	128	0.8850	0.9617	0.9218	0.9822
0.0581	2.0	192	0.0548	0.8283	0.9535	0.8865	86	0.9464	0.8933	0.9191	178	0.9690	0.9766	0.9728	128	0.9242	0.9337	0.9289	0.9852
0.0357	3.0	288	0.0514	0.8542	0.9535	0.9011	86	0.9310	0.9101	0.9205	178	0.9841	0.9688	0.9764	128	0.9293	0.9388	0.9340	0.9857
0.0251	4.0	384	0.0607	0.8989	0.9302	0.9143	86	0.8942	0.9494	0.9210	178	0.9837	0.9453	0.9641	128	0.9227	0.9439	0.9332	0.9852
0.0146	5.0	480	0.0617	0.8804	0.9419	0.9101	86	0.9231	0.9438	0.9333	178	0.976	0.9531	0.9644	128	0.9298	0.9464	0.9381	0.9865
0.0117	6.0	576	0.0706	0.8511	0.9302	0.8889	86	0.9066	0.9270	0.9167	178	0.9758	0.9453	0.9603	128	0.915	0.9337	0.9242	0.9857
0.0083	7.0	672	0.0926	0.7788	0.9419	0.8526	86	0.9162	0.9213	0.9188	178	0.9462	0.9609	0.9535	128	0.8910	0.9388	0.9143	0.9819
0.008	8.0	768	0.0781	0.8617	0.9419	0.9000	86	0.9535	0.9213	0.9371	178	0.984	0.9609	0.9723	128	0.9412	0.9388	0.9400	0.9857
0.0042	9.0	864	0.0659	0.8764	0.9070	0.8914	86	0.9663	0.9663	0.9663	178	0.9764	0.9688	0.9725	128	0.9492	0.9541	0.9517	0.9889
0.0044	10.0	960	0.0712	0.8681	0.9186	0.8927	86	0.9389	0.9494	0.9441	178	0.9457	0.9531	0.9494	128	0.925	0.9439	0.9343	0.9873
0.005	11.0	1056	0.0855	0.8384	0.9651	0.8973	86	0.9438	0.9438	0.9438	178	0.9762	0.9609	0.9685	128	0.9280	0.9541	0.9409	0.9870
0.0036	12.0	1152	0.0859	0.8710	0.9419	0.9050	86	0.9435	0.9382	0.9408	178	0.984	0.9609	0.9723	128	0.9392	0.9464	0.9428	0.9873
0.0042	13.0	1248	0.0761	0.8901	0.9419	0.9153	86	0.9448	0.9607	0.9526	178	0.984	0.9609	0.9723	128	0.9446	0.9566	0.9506	0.9889
0.0036	14.0	1344	0.0843	0.8876	0.9186	0.9029	86	0.9538	0.9270	0.9402	178	0.9841	0.9688	0.9764	128	0.9485	0.9388	0.9436	0.9862
0.0028	15.0	1440	0.0906	0.8723	0.9535	0.9111	86	0.9429	0.9270	0.9348	178	0.984	0.9609	0.9723	128	0.9391	0.9439	0.9415	0.9868
0.0017	16.0	1536	0.0914	0.8526	0.9419	0.8950	86	0.9645	0.9157	0.9395	178	0.9683	0.9531	0.9606	128	0.9385	0.9337	0.9361	0.9862
0.002	17.0	1632	0.0828	0.8587	0.9186	0.8876	86	0.9545	0.9438	0.9492	178	0.9762	0.9609	0.9685	128	0.9391	0.9439	0.9415	0.9884
0.0033	18.0	1728	0.0641	0.8646	0.9651	0.9121	86	0.9126	0.9382	0.9252	178	0.9841	0.9688	0.9764	128	0.9235	0.9541	0.9385	0.9887
0.0024	19.0	1824	0.0982	0.8667	0.9070	0.8864	86	0.9297	0.9663	0.9477	178	0.9683	0.9531	0.9606	128	0.9277	0.9490	0.9382	0.9868
0.0037	20.0	1920	0.0904	0.8283	0.9535	0.8865	86	0.9659	0.9551	0.9605	178	0.984	0.9609	0.9723	128	0.9375	0.9566	0.9470	0.9887
0.0038	21.0	2016	0.0787	0.8925	0.9651	0.9274	86	0.9385	0.9438	0.9412	178	0.9609	0.9609	0.9609	128	0.935	0.9541	0.9444	0.9879
0.0024	22.0	2112	0.0697	0.8526	0.9419	0.8950	86	0.9286	0.9494	0.9389	178	0.9677	0.9375	0.9524	128	0.9227	0.9439	0.9332	0.9889
0.0041	23.0	2208	0.0794	0.9011	0.9535	0.9266	86	0.9441	0.9494	0.9468	178	0.9685	0.9609	0.9647	128	0.9421	0.9541	0.9480	0.9876
0.0033	24.0	2304	0.0830	0.9	0.9419	0.9205	86	0.9231	0.9438	0.9333	178	0.9758	0.9453	0.9603	128	0.9343	0.9439	0.9391	0.9881
0.0034	25.0	2400	0.0804	0.8632	0.9535	0.9061	86	0.9448	0.9607	0.9526	178	0.9841	0.9688	0.9764	128	0.9378	0.9617	0.9496	0.9881
0.0012	26.0	2496	0.0728	0.9011	0.9535	0.9266	86	0.9341	0.9551	0.9444	178	0.9841	0.9688	0.9764	128	0.9424	0.9592	0.9507	0.9903
0.0015	27.0	2592	0.0957	0.9101	0.9419	0.9257	86	0.9301	0.9719	0.9505	178	0.9762	0.9609	0.9685	128	0.9401	0.9617	0.9508	0.9881
0.0029	28.0	2688	0.0766	0.8830	0.9651	0.9222	86	0.9545	0.9438	0.9492	178	0.9841	0.9688	0.9764	128	0.9470	0.9566	0.9518	0.9881
0.0031	29.0	2784	0.0802	0.8571	0.9767	0.9130	86	0.9649	0.9270	0.9456	178	0.9764	0.9688	0.9725	128	0.9419	0.9515	0.9467	0.9879
0.0018	30.0	2880	0.0837	0.8710	0.9419	0.9050	86	0.9605	0.9551	0.9577	178	0.9841	0.9688	0.9764	128	0.9470	0.9566	0.9518	0.9892
0.0017	31.0	2976	0.0792	0.9222	0.9651	0.9432	86	0.9505	0.9719	0.9611	178	0.9683	0.9531	0.9606	128	0.9497	0.9643	0.9570	0.9903
0.0017	32.0	3072	0.0675	0.8737	0.9651	0.9171	86	0.9661	0.9607	0.9634	178	0.976	0.9531	0.9644	128	0.9471	0.9592	0.9531	0.9906
0.0012	33.0	3168	0.0909	0.8925	0.9651	0.9274	86	0.9709	0.9382	0.9543	178	0.984	0.9609	0.9723	128	0.9564	0.9515	0.9540	0.9897
0.002	34.0	3264	0.1077	0.9101	0.9419	0.9257	86	0.9422	0.9157	0.9288	178	0.968	0.9453	0.9565	128	0.9432	0.9311	0.9371	0.9846
0.0023	35.0	3360	0.0912	0.8913	0.9535	0.9213	86	0.9396	0.9607	0.95	178	0.9762	0.9609	0.9685	128	0.94	0.9592	0.9495	0.9881
0.0016	36.0	3456	0.0839	0.8925	0.9651	0.9274	86	0.9655	0.9438	0.9545	178	0.984	0.9609	0.9723	128	0.9541	0.9541	0.9541	0.9892
0.0012	37.0	3552	0.1070	0.8817	0.9535	0.9162	86	0.9480	0.9213	0.9345	178	0.976	0.9531	0.9644	128	0.9412	0.9388	0.9400	0.9857
0.0009	38.0	3648	0.0856	0.8947	0.9884	0.9392	86	0.9540	0.9326	0.9432	178	0.984	0.9609	0.9723	128	0.9492	0.9541	0.9517	0.9884
0.0006	39.0	3744	0.0964	0.8936	0.9767	0.9333	86	0.9483	0.9270	0.9375	178	0.9685	0.9609	0.9647	128	0.9418	0.9490	0.9454	0.9862
0.0011	40.0	3840	0.0992	0.9011	0.9535	0.9266	86	0.9492	0.9438	0.9465	178	0.9762	0.9609	0.9685	128	0.9467	0.9515	0.9491	0.9870
0.0009	41.0	3936	0.1072	0.9032	0.9767	0.9385	86	0.9489	0.9382	0.9435	178	0.976	0.9531	0.9644	128	0.9467	0.9515	0.9491	0.9860
0.0007	42.0	4032	0.1193	0.8936	0.9767	0.9333	86	0.9595	0.9326	0.9459	178	0.9839	0.9531	0.9683	128	0.9514	0.9490	0.9502	0.9865
0.0014	43.0	4128	0.1129	0.9032	0.9767	0.9385	86	0.9489	0.9382	0.9435	178	0.9683	0.9531	0.9606	128	0.9443	0.9515	0.9479	0.9868
0.0007	44.0	4224	0.1289	0.9130	0.9767	0.9438	86	0.9492	0.9438	0.9465	178	0.9609	0.9609	0.9609	128	0.9446	0.9566	0.9506	0.9849
0.0006	45.0	4320	0.1167	0.8842	0.9767	0.9282	86	0.9392	0.9551	0.9471	178	0.9688	0.9688	0.9688	128	0.9356	0.9643	0.9497	0.9868
0.0014	46.0	4416	0.1168	0.8646	0.9651	0.9121	86	0.9543	0.9382	0.9462	178	0.9839	0.9531	0.9683	128	0.9418	0.9490	0.9454	0.9873
0.0022	47.0	4512	0.1090	0.8737	0.9651	0.9171	86	0.9702	0.9157	0.9422	178	0.9841	0.9688	0.9764	128	0.9512	0.9439	0.9475	0.9868
0.0033	48.0	4608	0.0899	0.9222	0.9651	0.9432	86	0.9333	0.9438	0.9385	178	0.9758	0.9453	0.9603	128	0.9442	0.9490	0.9466	0.9889
0.001	49.0	4704	0.1123	0.8830	0.9651	0.9222	86	0.9704	0.9213	0.9452	178	0.9839	0.9531	0.9683	128	0.9535	0.9413	0.9474	0.9870
0.0007	50.0	4800	0.0937	0.9011	0.9535	0.9266	86	0.9486	0.9326	0.9405	178	0.984	0.9609	0.9723	128	0.9488	0.9464	0.9476	0.9887
0.0011	51.0	4896	0.1082	0.9032	0.9767	0.9385	86	0.9278	0.9382	0.9330	178	0.9841	0.9688	0.9764	128	0.9398	0.9566	0.9482	0.9865
0.0015	52.0	4992	0.1112	0.9011	0.9535	0.9266	86	0.9645	0.9157	0.9395	178	0.9762	0.9609	0.9685	128	0.9534	0.9388	0.9460	0.9879
0.0009	53.0	5088	0.1032	0.8925	0.9651	0.9274	86	0.9341	0.9551	0.9444	178	0.984	0.9609	0.9723	128	0.94	0.9592	0.9495	0.9881
0.0033	54.0	5184	0.1181	0.8925	0.9651	0.9274	86	0.9593	0.9270	0.9429	178	0.984	0.9609	0.9723	128	0.9513	0.9464	0.9488	0.9870
0.0008	55.0	5280	0.1207	0.9022	0.9651	0.9326	86	0.9651	0.9326	0.9486	178	0.9688	0.9688	0.9688	128	0.9515	0.9515	0.9515	0.9865
0.0009	56.0	5376	0.1379	0.8632	0.9535	0.9061	86	0.9702	0.9157	0.9422	178	0.984	0.9609	0.9723	128	0.9485	0.9388	0.9436	0.9857
0.001	57.0	5472	0.1120	0.8925	0.9651	0.9274	86	0.9708	0.9326	0.9513	178	0.984	0.9609	0.9723	128	0.9563	0.9490	0.9526	0.9881
0.0013	58.0	5568	0.1086	0.8830	0.9651	0.9222	86	0.9483	0.9270	0.9375	178	0.9841	0.9688	0.9764	128	0.9442	0.9490	0.9466	0.9862
0.0005	59.0	5664	0.1218	0.8660	0.9767	0.9180	86	0.9641	0.9045	0.9333	178	0.9538	0.9688	0.9612	128	0.9365	0.9413	0.9389	0.9854
0.0007	60.0	5760	0.0958	0.8913	0.9535	0.9213	86	0.9239	0.9551	0.9392	178	0.9839	0.9531	0.9683	128	0.935	0.9541	0.9444	0.9881
0.0002	61.0	5856	0.1076	0.8817	0.9535	0.9162	86	0.9593	0.9270	0.9429	178	0.976	0.9531	0.9644	128	0.9462	0.9413	0.9437	0.9879
0.0023	62.0	5952	0.0877	0.9140	0.9884	0.9497	86	0.9494	0.9494	0.9494	178	0.9764	0.9688	0.9725	128	0.9497	0.9643	0.9570	0.9895
0.0013	63.0	6048	0.0885	0.9032	0.9767	0.9385	86	0.9448	0.9607	0.9526	178	0.9841	0.9688	0.9764	128	0.9475	0.9668	0.9571	0.9895
0.0009	64.0	6144	0.0825	0.9032	0.9767	0.9385	86	0.9605	0.9551	0.9577	178	0.9841	0.9688	0.9764	128	0.9545	0.9643	0.9594	0.9900
0.0003	65.0	6240	0.0838	0.9222	0.9651	0.9432	86	0.96	0.9438	0.9518	178	0.9841	0.9688	0.9764	128	0.9591	0.9566	0.9579	0.9884
0.0006	66.0	6336	0.0957	0.9032	0.9767	0.9385	86	0.96	0.9438	0.9518	178	0.9841	0.9688	0.9764	128	0.9543	0.9592	0.9567	0.9887
0.0004	67.0	6432	0.1129	0.8925	0.9651	0.9274	86	0.9649	0.9270	0.9456	178	0.9841	0.9688	0.9764	128	0.9538	0.9490	0.9514	0.9879
0.0003	68.0	6528	0.1161	0.8936	0.9767	0.9333	86	0.9538	0.9270	0.9402	178	0.9764	0.9688	0.9725	128	0.9467	0.9515	0.9491	0.9870
0.0002	69.0	6624	0.1234	0.8936	0.9767	0.9333	86	0.9645	0.9157	0.9395	178	0.9688	0.9688	0.9688	128	0.9488	0.9464	0.9476	0.9862
0.0006	70.0	6720	0.1162	0.9231	0.9767	0.9492	86	0.9651	0.9326	0.9486	178	0.9841	0.9688	0.9764	128	0.9614	0.9541	0.9577	0.9884
0.0002	71.0	6816	0.1107	0.9333	0.9767	0.9545	86	0.96	0.9438	0.9518	178	0.9841	0.9688	0.9764	128	0.9616	0.9592	0.9604	0.9879
0.0002	72.0	6912	0.1121	0.9231	0.9767	0.9492	86	0.9598	0.9382	0.9489	178	0.9841	0.9688	0.9764	128	0.9591	0.9566	0.9579	0.9879
0.0002	73.0	7008	0.1122	0.9231	0.9767	0.9492	86	0.9543	0.9382	0.9462	178	0.9841	0.9688	0.9764	128	0.9566	0.9566	0.9566	0.9881
0.0005	74.0	7104	0.1127	0.9231	0.9767	0.9492	86	0.9543	0.9382	0.9462	178	0.9841	0.9688	0.9764	128	0.9566	0.9566	0.9566	0.9873
0.0004	75.0	7200	0.1170	0.9130	0.9767	0.9438	86	0.9540	0.9326	0.9432	178	0.9688	0.9688	0.9688	128	0.9492	0.9541	0.9517	0.9862
0.0003	76.0	7296	0.1089	0.9333	0.9767	0.9545	86	0.9444	0.9551	0.9497	178	0.9762	0.9609	0.9685	128	0.9520	0.9617	0.9569	0.9892
0.001	77.0	7392	0.1082	0.9231	0.9767	0.9492	86	0.9503	0.9663	0.9582	178	0.9764	0.9688	0.9725	128	0.9524	0.9694	0.9608	0.9895
0.0012	78.0	7488	0.1009	0.9022	0.9651	0.9326	86	0.9330	0.9382	0.9356	178	0.9688	0.9688	0.9688	128	0.9373	0.9541	0.9456	0.9862
0.0002	79.0	7584	0.1051	0.8632	0.9535	0.9061	86	0.9489	0.9382	0.9435	178	0.976	0.9531	0.9644	128	0.9369	0.9464	0.9416	0.9865
0.0002	80.0	7680	0.1108	0.8723	0.9535	0.9111	86	0.9540	0.9326	0.9432	178	0.976	0.9531	0.9644	128	0.9415	0.9439	0.9427	0.9865
0.0005	81.0	7776	0.1037	0.8913	0.9535	0.9213	86	0.9543	0.9382	0.9462	178	0.9762	0.9609	0.9685	128	0.9466	0.9490	0.9478	0.9870
0.0003	82.0	7872	0.1031	0.8710	0.9419	0.9050	86	0.9540	0.9326	0.9432	178	0.976	0.9531	0.9644	128	0.9413	0.9413	0.9413	0.9868
0.0003	83.0	7968	0.0996	0.9121	0.9651	0.9379	86	0.9602	0.9494	0.9548	178	0.9685	0.9609	0.9647	128	0.9518	0.9566	0.9542	0.9887
0.0002	84.0	8064	0.0987	0.9222	0.9651	0.9432	86	0.9602	0.9494	0.9548	178	0.9685	0.9609	0.9647	128	0.9542	0.9566	0.9554	0.9887
0.0004	85.0	8160	0.1017	0.9222	0.9651	0.9432	86	0.9602	0.9494	0.9548	178	0.9685	0.9609	0.9647	128	0.9542	0.9566	0.9554	0.9887
0.0002	86.0	8256	0.1018	0.9222	0.9651	0.9432	86	0.9602	0.9494	0.9548	178	0.9685	0.9609	0.9647	128	0.9542	0.9566	0.9554	0.9887
0.0001	87.0	8352	0.1017	0.9222	0.9651	0.9432	86	0.9553	0.9607	0.9580	178	0.9685	0.9609	0.9647	128	0.9520	0.9617	0.9569	0.9889
0.0002	88.0	8448	0.1028	0.9222	0.9651	0.9432	86	0.9602	0.9494	0.9548	178	0.9685	0.9609	0.9647	128	0.9542	0.9566	0.9554	0.9887
0.0001	89.0	8544	0.1033	0.9222	0.9651	0.9432	86	0.9602	0.9494	0.9548	178	0.9685	0.9609	0.9647	128	0.9542	0.9566	0.9554	0.9887
0.0002	90.0	8640	0.1026	0.9213	0.9535	0.9371	86	0.9545	0.9438	0.9492	178	0.9762	0.9609	0.9685	128	0.9540	0.9515	0.9527	0.9879
0.0002	91.0	8736	0.1024	0.9213	0.9535	0.9371	86	0.9545	0.9438	0.9492	178	0.9762	0.9609	0.9685	128	0.9540	0.9515	0.9527	0.9879
0.0002	92.0	8832	0.1025	0.9213	0.9535	0.9371	86	0.9545	0.9438	0.9492	178	0.9762	0.9609	0.9685	128	0.9540	0.9515	0.9527	0.9879
0.0002	93.0	8928	0.1039	0.9213	0.9535	0.9371	86	0.9545	0.9438	0.9492	178	0.9762	0.9609	0.9685	128	0.9540	0.9515	0.9527	0.9879
0.0001	94.0	9024	0.1034	0.9213	0.9535	0.9371	86	0.9545	0.9438	0.9492	178	0.9762	0.9609	0.9685	128	0.9540	0.9515	0.9527	0.9879
0.0001	95.0	9120	0.1036	0.9213	0.9535	0.9371	86	0.9545	0.9438	0.9492	178	0.9762	0.9609	0.9685	128	0.9540	0.9515	0.9527	0.9879
0.0001	96.0	9216	0.1087	0.8925	0.9651	0.9274	86	0.9538	0.9270	0.9402	178	0.9762	0.9609	0.9685	128	0.9464	0.9464	0.9464	0.9873
0.0005	97.0	9312	0.1056	0.8925	0.9651	0.9274	86	0.9538	0.9270	0.9402	178	0.9685	0.9609	0.9647	128	0.9440	0.9464	0.9452	0.9876
0.0003	98.0	9408	0.1045	0.8925	0.9651	0.9274	86	0.9538	0.9270	0.9402	178	0.9685	0.9609	0.9647	128	0.9440	0.9464	0.9452	0.9876
0.0001	99.0	9504	0.1047	0.8925	0.9651	0.9274	86	0.9538	0.9270	0.9402	178	0.9685	0.9609	0.9647	128	0.9440	0.9464	0.9452	0.9876
0.0002	100.0	9600	0.1047	0.8925	0.9651	0.9274	86	0.9538	0.9270	0.9402	178	0.9685	0.9609	0.9647	128	0.9440	0.9464	0.9452	0.9876

Framework versions

• Transformers 4.39.3
• Pytorch 2.3.0+cu121
• Datasets 2.19.1
• Tokenizers 0.15.2