nerui-unipelt-1

This model is a fine-tuned version of indolem/indobert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.0617
• Location Precision: 0.9244
• Location Recall: 0.9483
• Location F1: 0.9362
• Location Number: 116
• Organization Precision: 0.9419
• Organization Recall: 0.9241
• Organization F1: 0.9329
• Organization Number: 158
• Person Precision: 0.984
• Person Recall: 0.9919
• Person F1: 0.9880
• Person Number: 124
• Overall Precision: 0.9499
• Overall Recall: 0.9523
• Overall F1: 0.9511
• Overall Accuracy: 0.9898

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 16
• eval_batch_size: 64
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100.0

Training results

Training Loss	Epoch	Step	Validation Loss	Location Precision	Location Recall	Location F1	Location Number	Organization Precision	Organization Recall	Organization F1	Organization Number	Person Precision	Person Recall	Person F1	Person Number	Overall Precision	Overall Recall	Overall F1	Overall Accuracy
0.8594	1.0	96	0.4997	0.0	0.0	0.0	116	0.3333	0.0063	0.0124	158	0.0	0.0	0.0	124	0.2	0.0025	0.0050	0.8397
0.3949	2.0	192	0.2252	0.4180	0.4397	0.4286	116	0.5604	0.6456	0.6	158	0.5562	0.7581	0.6416	124	0.5222	0.6206	0.5672	0.9330
0.1905	3.0	288	0.1096	0.7565	0.75	0.7532	116	0.6915	0.8228	0.7514	158	0.8978	0.9919	0.9425	124	0.7727	0.8543	0.8115	0.9654
0.1245	4.0	384	0.0806	0.7481	0.8707	0.8048	116	0.7640	0.8608	0.8095	158	0.9318	0.9919	0.9609	124	0.8090	0.9045	0.8541	0.9726
0.1021	5.0	480	0.0540	0.8957	0.8879	0.8918	116	0.8373	0.8797	0.8580	158	0.9685	0.9919	0.9801	124	0.8946	0.9171	0.9057	0.9822
0.087	6.0	576	0.0530	0.7970	0.9138	0.8514	116	0.9021	0.8165	0.8571	158	0.9535	0.9919	0.9723	124	0.8840	0.8995	0.8917	0.9811
0.0748	7.0	672	0.0469	0.9035	0.8879	0.8957	116	0.8402	0.8987	0.8685	158	0.9762	0.9919	0.9840	124	0.8998	0.9246	0.9120	0.9833
0.0685	8.0	768	0.0424	0.9076	0.9310	0.9191	116	0.9182	0.9241	0.9211	158	0.9762	0.9919	0.9840	124	0.9332	0.9472	0.9401	0.9863
0.0611	9.0	864	0.0377	0.8934	0.9397	0.9160	116	0.8957	0.9241	0.9097	158	0.984	0.9919	0.9880	124	0.9220	0.9497	0.9356	0.9879
0.0573	10.0	960	0.0421	0.8594	0.9483	0.9016	116	0.9221	0.8987	0.9103	158	0.9762	0.9919	0.9840	124	0.9191	0.9422	0.9305	0.9855
0.054	11.0	1056	0.0359	0.9008	0.9397	0.9198	116	0.9477	0.9177	0.9325	158	0.984	0.9919	0.9880	124	0.9449	0.9472	0.9460	0.9885
0.0454	12.0	1152	0.0335	0.9231	0.9310	0.9270	116	0.9484	0.9304	0.9393	158	0.9762	0.9919	0.9840	124	0.9497	0.9497	0.9497	0.9898
0.0426	13.0	1248	0.0333	0.9322	0.9483	0.9402	116	0.9367	0.9367	0.9367	158	0.984	0.9919	0.9880	124	0.9501	0.9573	0.9537	0.9909
0.0392	14.0	1344	0.0348	0.9256	0.9655	0.9451	116	0.9359	0.9241	0.9299	158	0.984	0.9919	0.9880	124	0.9478	0.9573	0.9525	0.9896
0.0371	15.0	1440	0.0349	0.9098	0.9569	0.9328	116	0.9367	0.9367	0.9367	158	0.984	0.9919	0.9880	124	0.9432	0.9598	0.9514	0.9898
0.0339	16.0	1536	0.0343	0.9113	0.9741	0.9417	116	0.9412	0.9114	0.9260	158	0.984	0.9919	0.9880	124	0.9453	0.9548	0.95	0.9896
0.0331	17.0	1632	0.0359	0.9237	0.9397	0.9316	116	0.9136	0.9367	0.9250	158	0.9762	0.9919	0.9840	124	0.9360	0.9548	0.9453	0.9896
0.031	18.0	1728	0.0358	0.9016	0.9483	0.9244	116	0.9487	0.9367	0.9427	158	0.984	0.9919	0.9880	124	0.9454	0.9573	0.9513	0.9898
0.0295	19.0	1824	0.0303	0.9322	0.9483	0.9402	116	0.925	0.9367	0.9308	158	0.984	0.9919	0.9880	124	0.9454	0.9573	0.9513	0.9912
0.0273	20.0	1920	0.0342	0.9180	0.9655	0.9412	116	0.9299	0.9241	0.9270	158	0.984	0.9919	0.9880	124	0.9431	0.9573	0.9501	0.9907
0.0258	21.0	2016	0.0384	0.8889	0.9655	0.9256	116	0.9363	0.9304	0.9333	158	0.984	0.9919	0.9880	124	0.9363	0.9598	0.9479	0.9890
0.0225	22.0	2112	0.0322	0.9237	0.9397	0.9316	116	0.9255	0.9430	0.9342	158	0.984	0.9919	0.9880	124	0.9431	0.9573	0.9501	0.9901
0.0211	23.0	2208	0.0353	0.9244	0.9483	0.9362	116	0.9484	0.9304	0.9393	158	0.9762	0.9919	0.9840	124	0.95	0.9548	0.9524	0.9904
0.0213	24.0	2304	0.0355	0.9402	0.9483	0.9442	116	0.9416	0.9177	0.9295	158	0.984	0.9919	0.9880	124	0.9545	0.9497	0.9521	0.9898
0.0197	25.0	2400	0.0342	0.9174	0.9569	0.9367	116	0.9545	0.9304	0.9423	158	0.984	0.9919	0.9880	124	0.9525	0.9573	0.9549	0.9909
0.022	26.0	2496	0.0349	0.9316	0.9397	0.9356	116	0.9481	0.9241	0.9359	158	0.984	0.9919	0.9880	124	0.9545	0.9497	0.9521	0.9904
0.019	27.0	2592	0.0320	0.9402	0.9483	0.9442	116	0.9430	0.9430	0.9430	158	0.984	0.9919	0.9880	124	0.955	0.9598	0.9574	0.9912
0.0174	28.0	2688	0.0415	0.9492	0.9655	0.9573	116	0.9484	0.9304	0.9393	158	0.984	0.9919	0.9880	124	0.9598	0.9598	0.9598	0.9898
0.0164	29.0	2784	0.0383	0.925	0.9569	0.9407	116	0.9308	0.9367	0.9338	158	0.984	0.9919	0.9880	124	0.9455	0.9598	0.9526	0.9901
0.0166	30.0	2880	0.0414	0.9322	0.9483	0.9402	116	0.8869	0.9430	0.9141	158	0.984	0.9919	0.9880	124	0.9294	0.9598	0.9444	0.9890
0.0162	31.0	2976	0.0371	0.925	0.9569	0.9407	116	0.9363	0.9304	0.9333	158	0.984	0.9919	0.9880	124	0.9478	0.9573	0.9525	0.9907
0.0157	32.0	3072	0.0402	0.925	0.9569	0.9407	116	0.9419	0.9241	0.9329	158	0.9762	0.9919	0.9840	124	0.9476	0.9548	0.9512	0.9893
0.0137	33.0	3168	0.0428	0.925	0.9569	0.9407	116	0.9539	0.9177	0.9355	158	0.984	0.9919	0.9880	124	0.9547	0.9523	0.9535	0.9893
0.0146	34.0	3264	0.0422	0.9333	0.9655	0.9492	116	0.9363	0.9304	0.9333	158	0.984	0.9919	0.9880	124	0.9502	0.9598	0.9550	0.9896
0.0139	35.0	3360	0.0435	0.9333	0.9655	0.9492	116	0.9299	0.9241	0.9270	158	0.976	0.9839	0.9799	124	0.9453	0.9548	0.95	0.9898
0.0126	36.0	3456	0.0428	0.9328	0.9569	0.9447	116	0.9669	0.9241	0.9450	158	0.984	0.9919	0.9880	124	0.9620	0.9548	0.9584	0.9898
0.0112	37.0	3552	0.0404	0.9339	0.9741	0.9536	116	0.9545	0.9304	0.9423	158	0.984	0.9919	0.9880	124	0.9575	0.9623	0.9599	0.9912
0.0121	38.0	3648	0.0483	0.9328	0.9569	0.9447	116	0.9732	0.9177	0.9446	158	0.984	0.9919	0.9880	124	0.9644	0.9523	0.9583	0.9898
0.0101	39.0	3744	0.0465	0.925	0.9569	0.9407	116	0.9667	0.9177	0.9416	158	0.984	0.9919	0.9880	124	0.9595	0.9523	0.9559	0.9901
0.0106	40.0	3840	0.0437	0.9244	0.9483	0.9362	116	0.9667	0.9177	0.9416	158	0.984	0.9919	0.9880	124	0.9594	0.9497	0.9545	0.9896
0.0113	41.0	3936	0.0478	0.925	0.9569	0.9407	116	0.9299	0.9241	0.9270	158	0.984	0.9919	0.9880	124	0.9453	0.9548	0.95	0.9898
0.0088	42.0	4032	0.0529	0.9098	0.9569	0.9328	116	0.9542	0.9241	0.9389	158	0.984	0.9919	0.9880	124	0.95	0.9548	0.9524	0.9887
0.0092	43.0	4128	0.0494	0.925	0.9569	0.9407	116	0.9664	0.9114	0.9381	158	0.984	0.9919	0.9880	124	0.9594	0.9497	0.9545	0.9901
0.0083	44.0	4224	0.0481	0.925	0.9569	0.9407	116	0.9735	0.9304	0.9515	158	0.984	0.9919	0.9880	124	0.9621	0.9573	0.9597	0.9901
0.0104	45.0	4320	0.0548	0.9174	0.9569	0.9367	116	0.9664	0.9114	0.9381	158	0.984	0.9919	0.9880	124	0.9570	0.9497	0.9533	0.9890
0.0085	46.0	4416	0.0535	0.9098	0.9569	0.9328	116	0.9610	0.9367	0.9487	158	0.984	0.9919	0.9880	124	0.9526	0.9598	0.9562	0.9896
0.0075	47.0	4512	0.0533	0.9091	0.9483	0.9283	116	0.9605	0.9241	0.9419	158	0.976	0.9839	0.9799	124	0.9497	0.9497	0.9497	0.9887
0.0084	48.0	4608	0.0462	0.9333	0.9655	0.9492	116	0.9548	0.9367	0.9457	158	0.984	0.9919	0.9880	124	0.9575	0.9623	0.9599	0.9901
0.007	49.0	4704	0.0518	0.9328	0.9569	0.9447	116	0.9735	0.9304	0.9515	158	0.984	0.9919	0.9880	124	0.9646	0.9573	0.9609	0.9907
0.0073	50.0	4800	0.0465	0.9333	0.9655	0.9492	116	0.9610	0.9367	0.9487	158	0.984	0.9919	0.9880	124	0.9599	0.9623	0.9611	0.9901
0.0072	51.0	4896	0.0535	0.9256	0.9655	0.9451	116	0.9673	0.9367	0.9518	158	0.984	0.9919	0.9880	124	0.9599	0.9623	0.9611	0.9901
0.0066	52.0	4992	0.0524	0.9098	0.9569	0.9328	116	0.9367	0.9367	0.9367	158	0.984	0.9919	0.9880	124	0.9432	0.9598	0.9514	0.9898
0.0075	53.0	5088	0.0535	0.9256	0.9655	0.9451	116	0.9671	0.9304	0.9484	158	0.984	0.9919	0.9880	124	0.9598	0.9598	0.9598	0.9898
0.0068	54.0	5184	0.0589	0.9174	0.9569	0.9367	116	0.9548	0.9367	0.9457	158	0.984	0.9919	0.9880	124	0.9526	0.9598	0.9562	0.9896
0.007	55.0	5280	0.0497	0.925	0.9569	0.9407	116	0.9548	0.9367	0.9457	158	0.984	0.9919	0.9880	124	0.955	0.9598	0.9574	0.9909
0.0063	56.0	5376	0.0514	0.9256	0.9655	0.9451	116	0.9313	0.9430	0.9371	158	0.984	0.9919	0.9880	124	0.9458	0.9648	0.9552	0.9901
0.0051	57.0	5472	0.0527	0.9328	0.9569	0.9447	116	0.9548	0.9367	0.9457	158	0.984	0.9919	0.9880	124	0.9574	0.9598	0.9586	0.9909
0.0064	58.0	5568	0.0566	0.925	0.9569	0.9407	116	0.9548	0.9367	0.9457	158	0.984	0.9919	0.9880	124	0.955	0.9598	0.9574	0.9907
0.0049	59.0	5664	0.0573	0.9174	0.9569	0.9367	116	0.9304	0.9304	0.9304	158	0.984	0.9919	0.9880	124	0.9431	0.9573	0.9501	0.9890
0.0046	60.0	5760	0.0577	0.925	0.9569	0.9407	116	0.9487	0.9367	0.9427	158	0.984	0.9919	0.9880	124	0.9526	0.9598	0.9562	0.9901
0.0049	61.0	5856	0.0581	0.925	0.9569	0.9407	116	0.9542	0.9241	0.9389	158	0.976	0.9839	0.9799	124	0.9523	0.9523	0.9523	0.9898
0.0043	62.0	5952	0.0570	0.9328	0.9569	0.9447	116	0.9548	0.9367	0.9457	158	0.976	0.9839	0.9799	124	0.9549	0.9573	0.9561	0.9904
0.0048	63.0	6048	0.0572	0.9167	0.9483	0.9322	116	0.9548	0.9367	0.9457	158	0.984	0.9919	0.9880	124	0.9525	0.9573	0.9549	0.9898
0.0055	64.0	6144	0.0586	0.925	0.9569	0.9407	116	0.9484	0.9304	0.9393	158	0.984	0.9919	0.9880	124	0.9525	0.9573	0.9549	0.9898
0.0052	65.0	6240	0.0592	0.9167	0.9483	0.9322	116	0.9487	0.9367	0.9427	158	0.984	0.9919	0.9880	124	0.9501	0.9573	0.9537	0.9904
0.0041	66.0	6336	0.0551	0.925	0.9569	0.9407	116	0.9423	0.9304	0.9363	158	0.976	0.9839	0.9799	124	0.9476	0.9548	0.9512	0.9898
0.0048	67.0	6432	0.0619	0.9174	0.9569	0.9367	116	0.9603	0.9177	0.9385	158	0.976	0.9839	0.9799	124	0.9521	0.9497	0.9509	0.9890
0.0033	68.0	6528	0.0590	0.9167	0.9483	0.9322	116	0.9427	0.9367	0.9397	158	0.984	0.9919	0.9880	124	0.9478	0.9573	0.9525	0.9901
0.0038	69.0	6624	0.0588	0.925	0.9569	0.9407	116	0.9608	0.9304	0.9453	158	0.984	0.9919	0.9880	124	0.9573	0.9573	0.9573	0.9901
0.0043	70.0	6720	0.0531	0.925	0.9569	0.9407	116	0.925	0.9367	0.9308	158	0.984	0.9919	0.9880	124	0.9432	0.9598	0.9514	0.9896
0.0051	71.0	6816	0.0577	0.9083	0.9397	0.9237	116	0.9304	0.9304	0.9304	158	0.984	0.9919	0.9880	124	0.9404	0.9523	0.9463	0.9893
0.0035	72.0	6912	0.0587	0.9167	0.9483	0.9322	116	0.9299	0.9241	0.9270	158	0.984	0.9919	0.9880	124	0.9428	0.9523	0.9475	0.9898
0.0041	73.0	7008	0.0580	0.9167	0.9483	0.9322	116	0.9359	0.9241	0.9299	158	0.984	0.9919	0.9880	124	0.9451	0.9523	0.9487	0.9898
0.0039	74.0	7104	0.0560	0.9244	0.9483	0.9362	116	0.9605	0.9241	0.9419	158	0.984	0.9919	0.9880	124	0.9571	0.9523	0.9547	0.9896
0.0037	75.0	7200	0.0577	0.9167	0.9483	0.9322	116	0.9304	0.9304	0.9304	158	0.984	0.9919	0.9880	124	0.9429	0.9548	0.9488	0.9898
0.0035	76.0	7296	0.0574	0.9167	0.9483	0.9322	116	0.9304	0.9304	0.9304	158	0.984	0.9919	0.9880	124	0.9429	0.9548	0.9488	0.9901
0.0036	77.0	7392	0.0572	0.925	0.9569	0.9407	116	0.9304	0.9304	0.9304	158	0.984	0.9919	0.9880	124	0.9454	0.9573	0.9513	0.9904
0.0038	78.0	7488	0.0574	0.925	0.9569	0.9407	116	0.9304	0.9304	0.9304	158	0.984	0.9919	0.9880	124	0.9454	0.9573	0.9513	0.9904
0.0028	79.0	7584	0.0595	0.925	0.9569	0.9407	116	0.9419	0.9241	0.9329	158	0.984	0.9919	0.9880	124	0.95	0.9548	0.9524	0.9901
0.0035	80.0	7680	0.0618	0.925	0.9569	0.9407	116	0.9542	0.9241	0.9389	158	0.984	0.9919	0.9880	124	0.9548	0.9548	0.9548	0.9896
0.0038	81.0	7776	0.0599	0.9160	0.9397	0.9277	116	0.9545	0.9304	0.9423	158	0.984	0.9919	0.9880	124	0.9523	0.9523	0.9523	0.9893
0.0029	82.0	7872	0.0584	0.9160	0.9397	0.9277	116	0.9304	0.9304	0.9304	158	0.984	0.9919	0.9880	124	0.9428	0.9523	0.9475	0.9893
0.0037	83.0	7968	0.0632	0.9160	0.9397	0.9277	116	0.9419	0.9241	0.9329	158	0.984	0.9919	0.9880	124	0.9474	0.9497	0.9486	0.9893
0.003	84.0	8064	0.0565	0.9244	0.9483	0.9362	116	0.9419	0.9241	0.9329	158	0.984	0.9919	0.9880	124	0.9499	0.9523	0.9511	0.9898
0.0022	85.0	8160	0.0610	0.9244	0.9483	0.9362	116	0.9419	0.9241	0.9329	158	0.984	0.9919	0.9880	124	0.9499	0.9523	0.9511	0.9898
0.0033	86.0	8256	0.0600	0.925	0.9569	0.9407	116	0.9419	0.9241	0.9329	158	0.984	0.9919	0.9880	124	0.95	0.9548	0.9524	0.9898
0.0023	87.0	8352	0.0624	0.9328	0.9569	0.9447	116	0.9359	0.9241	0.9299	158	0.984	0.9919	0.9880	124	0.95	0.9548	0.9524	0.9893
0.002	88.0	8448	0.0611	0.9244	0.9483	0.9362	116	0.9542	0.9241	0.9389	158	0.984	0.9919	0.9880	124	0.9547	0.9523	0.9535	0.9893
0.0027	89.0	8544	0.0612	0.9244	0.9483	0.9362	116	0.9481	0.9241	0.9359	158	0.984	0.9919	0.9880	124	0.9523	0.9523	0.9523	0.9901
0.0029	90.0	8640	0.0617	0.9244	0.9483	0.9362	116	0.9419	0.9241	0.9329	158	0.984	0.9919	0.9880	124	0.9499	0.9523	0.9511	0.9896
0.0028	91.0	8736	0.0596	0.9244	0.9483	0.9362	116	0.9419	0.9241	0.9329	158	0.984	0.9919	0.9880	124	0.9499	0.9523	0.9511	0.9898
0.003	92.0	8832	0.0622	0.9328	0.9569	0.9447	116	0.9481	0.9241	0.9359	158	0.984	0.9919	0.9880	124	0.9548	0.9548	0.9548	0.9898
0.0027	93.0	8928	0.0620	0.9328	0.9569	0.9447	116	0.9419	0.9241	0.9329	158	0.984	0.9919	0.9880	124	0.9524	0.9548	0.9536	0.9901
0.0026	94.0	9024	0.0602	0.9244	0.9483	0.9362	116	0.9542	0.9241	0.9389	158	0.984	0.9919	0.9880	124	0.9547	0.9523	0.9535	0.9898
0.0021	95.0	9120	0.0612	0.9328	0.9569	0.9447	116	0.9545	0.9304	0.9423	158	0.984	0.9919	0.9880	124	0.9573	0.9573	0.9573	0.9904
0.0024	96.0	9216	0.0618	0.9244	0.9483	0.9362	116	0.9545	0.9304	0.9423	158	0.984	0.9919	0.9880	124	0.9548	0.9548	0.9548	0.9901
0.0029	97.0	9312	0.0613	0.9244	0.9483	0.9362	116	0.9419	0.9241	0.9329	158	0.984	0.9919	0.9880	124	0.9499	0.9523	0.9511	0.9898
0.0023	98.0	9408	0.0611	0.9244	0.9483	0.9362	116	0.9419	0.9241	0.9329	158	0.984	0.9919	0.9880	124	0.9499	0.9523	0.9511	0.9898
0.0025	99.0	9504	0.0616	0.9244	0.9483	0.9362	116	0.9419	0.9241	0.9329	158	0.984	0.9919	0.9880	124	0.9499	0.9523	0.9511	0.9898
0.0024	100.0	9600	0.0617	0.9244	0.9483	0.9362	116	0.9419	0.9241	0.9329	158	0.984	0.9919	0.9880	124	0.9499	0.9523	0.9511	0.9898

Framework versions

• Transformers 4.39.3
• Pytorch 2.3.0+cu121
• Datasets 2.19.1
• Tokenizers 0.15.2