nerui-unipelt-0

This model is a fine-tuned version of indolem/indobert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.0592
• Location Precision: 0.8738
• Location Recall: 0.9574
• Location F1: 0.9137
• Location Number: 94
• Organization Precision: 0.8994
• Organization Recall: 0.9102
• Organization F1: 0.9048
• Organization Number: 167
• Person Precision: 0.9781
• Person Recall: 0.9781
• Person F1: 0.9781
• Person Number: 137
• Overall Precision: 0.9193
• Overall Recall: 0.9447
• Overall F1: 0.9318
• Overall Accuracy: 0.9867

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 16
• eval_batch_size: 64
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100.0

Training results

Training Loss	Epoch	Step	Validation Loss	Location Precision	Location Recall	Location F1	Location Number	Organization Precision	Organization Recall	Organization F1	Organization Number	Person Precision	Person Recall	Person F1	Person Number	Overall Precision	Overall Recall	Overall F1	Overall Accuracy
0.8691	1.0	96	0.5068	0.0	0.0	0.0	94	0.6667	0.0120	0.0235	167	0.1429	0.0073	0.0139	137	0.3	0.0075	0.0147	0.8351
0.3831	2.0	192	0.2198	0.3763	0.3723	0.3743	94	0.4935	0.6826	0.5729	167	0.7453	0.8759	0.8054	137	0.5546	0.6759	0.6093	0.9318
0.1821	3.0	288	0.0957	0.7789	0.7872	0.7831	94	0.7407	0.8383	0.7865	167	0.9571	0.9781	0.9675	137	0.8208	0.8744	0.8467	0.9691
0.1207	4.0	384	0.0757	0.7632	0.9255	0.8365	94	0.7865	0.8383	0.8116	167	0.9712	0.9854	0.9783	137	0.8399	0.9095	0.8733	0.9740
0.0982	5.0	480	0.0582	0.8020	0.8617	0.8308	94	0.8820	0.8503	0.8659	167	0.9571	0.9781	0.9675	137	0.8881	0.8970	0.8925	0.9796
0.0798	6.0	576	0.0528	0.8019	0.9043	0.8500	94	0.8571	0.8982	0.8772	167	0.9855	0.9927	0.9891	137	0.8854	0.9322	0.9082	0.9818
0.0718	7.0	672	0.0513	0.7857	0.9362	0.8544	94	0.8735	0.8683	0.8709	167	0.9783	0.9854	0.9818	137	0.8846	0.9246	0.9042	0.9815
0.0652	8.0	768	0.0449	0.8241	0.9468	0.8812	94	0.8848	0.8743	0.8795	167	0.9926	0.9854	0.9890	137	0.9046	0.9296	0.9170	0.9840
0.0583	9.0	864	0.0453	0.8333	0.9574	0.8911	94	0.8963	0.8802	0.8882	167	0.9927	0.9927	0.9927	137	0.9120	0.9372	0.9244	0.9848
0.0527	10.0	960	0.0432	0.8544	0.9362	0.8934	94	0.8613	0.8922	0.8765	167	1.0	0.9781	0.9889	137	0.9049	0.9322	0.9183	0.9829
0.0489	11.0	1056	0.0411	0.8641	0.9468	0.9036	94	0.8922	0.8922	0.8922	167	0.9854	0.9854	0.9854	137	0.9165	0.9372	0.9267	0.9854
0.0463	12.0	1152	0.0461	0.8641	0.9468	0.9036	94	0.8795	0.8743	0.8769	167	0.9926	0.9854	0.9890	137	0.9136	0.9296	0.9215	0.9840
0.0432	13.0	1248	0.0435	0.8396	0.9468	0.89	94	0.8817	0.8922	0.8869	167	0.9779	0.9708	0.9744	137	0.9027	0.9322	0.9172	0.9851
0.0394	14.0	1344	0.0464	0.8529	0.9255	0.8878	94	0.8795	0.8743	0.8769	167	0.9571	0.9781	0.9675	137	0.8995	0.9221	0.9107	0.9820
0.0366	15.0	1440	0.0398	0.8980	0.9362	0.9167	94	0.9102	0.9102	0.9102	167	0.9781	0.9781	0.9781	137	0.9303	0.9397	0.9350	0.9856
0.0356	16.0	1536	0.0372	0.9158	0.9255	0.9206	94	0.9012	0.9281	0.9145	167	0.9852	0.9708	0.9779	137	0.9328	0.9422	0.9375	0.9867
0.0308	17.0	1632	0.0406	0.8641	0.9468	0.9036	94	0.9085	0.8922	0.9003	167	0.9710	0.9781	0.9745	137	0.9185	0.9347	0.9265	0.9848
0.0313	18.0	1728	0.0389	0.8725	0.9468	0.9082	94	0.9744	0.9102	0.9412	167	0.9571	0.9781	0.9675	137	0.9422	0.9422	0.9422	0.9876
0.0288	19.0	1824	0.0402	0.8878	0.9255	0.9062	94	0.9383	0.9102	0.9240	167	0.9783	0.9854	0.9818	137	0.9397	0.9397	0.9397	0.9873
0.0263	20.0	1920	0.0443	0.8544	0.9362	0.8934	94	0.9074	0.8802	0.8936	167	0.9783	0.9854	0.9818	137	0.9181	0.9296	0.9238	0.9854
0.0245	21.0	2016	0.0430	0.8365	0.9255	0.8788	94	0.8935	0.9042	0.8988	167	0.9783	0.9854	0.9818	137	0.9075	0.9372	0.9221	0.9848
0.0254	22.0	2112	0.0498	0.8381	0.9362	0.8844	94	0.8929	0.8982	0.8955	167	0.9854	0.9854	0.9854	137	0.9098	0.9372	0.9233	0.9837
0.0232	23.0	2208	0.0435	0.8667	0.9681	0.9146	94	0.9299	0.8743	0.9012	167	0.9854	0.9854	0.9854	137	0.9323	0.9347	0.9335	0.9859
0.0204	24.0	2304	0.0446	0.8679	0.9787	0.9200	94	0.8896	0.8683	0.8788	167	0.9640	0.9781	0.9710	137	0.9093	0.9322	0.9206	0.9856
0.0222	25.0	2400	0.0430	0.9010	0.9681	0.9333	94	0.9102	0.9102	0.9102	167	0.9855	0.9927	0.9891	137	0.9335	0.9523	0.9428	0.9865
0.0204	26.0	2496	0.0383	0.8878	0.9255	0.9062	94	0.8706	0.8862	0.8783	167	0.9783	0.9854	0.9818	137	0.9113	0.9296	0.9204	0.9859
0.0186	27.0	2592	0.0407	0.9167	0.9362	0.9263	94	0.8851	0.9222	0.9032	167	0.9855	0.9927	0.9891	137	0.9265	0.9497	0.9380	0.9873
0.0209	28.0	2688	0.0472	0.8462	0.9362	0.8889	94	0.8922	0.8922	0.8922	167	0.9855	0.9927	0.9891	137	0.9120	0.9372	0.9244	0.9845
0.0171	29.0	2784	0.0443	0.8713	0.9362	0.9026	94	0.9136	0.8862	0.8997	167	0.9783	0.9854	0.9818	137	0.9252	0.9322	0.9287	0.9856
0.0171	30.0	2880	0.0457	0.8958	0.9149	0.9053	94	0.8844	0.9162	0.9	167	0.9855	0.9927	0.9891	137	0.9214	0.9422	0.9317	0.9867
0.0164	31.0	2976	0.0497	0.8812	0.9468	0.9128	94	0.9136	0.8862	0.8997	167	0.9926	0.9854	0.9890	137	0.9323	0.9347	0.9335	0.9859
0.0151	32.0	3072	0.0477	0.8812	0.9468	0.9128	94	0.9024	0.8862	0.8943	167	0.9926	0.9854	0.9890	137	0.9277	0.9347	0.9312	0.9854
0.0147	33.0	3168	0.0459	0.8641	0.9468	0.9036	94	0.9080	0.8862	0.8970	167	0.9927	0.9927	0.9927	137	0.9256	0.9372	0.9313	0.9862
0.0142	34.0	3264	0.0485	0.8447	0.9255	0.8832	94	0.8941	0.9102	0.9021	167	0.9927	0.9927	0.9927	137	0.9146	0.9422	0.9282	0.9856
0.0134	35.0	3360	0.0579	0.8257	0.9574	0.8867	94	0.9091	0.8383	0.8723	167	0.9781	0.9781	0.9781	137	0.91	0.9146	0.9123	0.9831
0.0123	36.0	3456	0.0508	0.8725	0.9468	0.9082	94	0.9102	0.9102	0.9102	167	0.9781	0.9781	0.9781	137	0.9236	0.9422	0.9328	0.9867
0.0133	37.0	3552	0.0473	0.9158	0.9255	0.9206	94	0.8715	0.9341	0.9017	167	0.9854	0.9854	0.9854	137	0.9197	0.9497	0.9345	0.9862
0.0105	38.0	3648	0.0483	0.8738	0.9574	0.9137	94	0.9212	0.9102	0.9157	167	0.9926	0.9781	0.9853	137	0.9330	0.9447	0.9388	0.9865
0.012	39.0	3744	0.0404	0.9293	0.9787	0.9534	94	0.9006	0.9222	0.9112	167	0.9710	0.9781	0.9745	137	0.9314	0.9548	0.9429	0.9895
0.0116	40.0	3840	0.0490	0.8627	0.9362	0.8980	94	0.8862	0.8862	0.8862	167	0.9640	0.9781	0.9710	137	0.9069	0.9296	0.9181	0.9862
0.0104	41.0	3936	0.0579	0.8544	0.9362	0.8934	94	0.8982	0.8982	0.8982	167	0.9927	0.9927	0.9927	137	0.9189	0.9397	0.9292	0.9848
0.0111	42.0	4032	0.0515	0.875	0.9681	0.9192	94	0.8902	0.8743	0.8822	167	0.9927	0.9927	0.9927	137	0.9210	0.9372	0.9290	0.9859
0.0094	43.0	4128	0.0655	0.8224	0.9362	0.8756	94	0.9042	0.9042	0.9042	167	0.9927	0.9927	0.9927	137	0.9124	0.9422	0.9271	0.9837
0.0091	44.0	4224	0.0648	0.8396	0.9468	0.89	94	0.9006	0.8683	0.8841	167	0.9781	0.9781	0.9781	137	0.9109	0.9246	0.9177	0.9845
0.0085	45.0	4320	0.0548	0.8738	0.9574	0.9137	94	0.8844	0.9162	0.9	167	0.9783	0.9854	0.9818	137	0.9130	0.9497	0.9310	0.9856
0.0092	46.0	4416	0.0582	0.8544	0.9362	0.8934	94	0.8795	0.8743	0.8769	167	0.9783	0.9854	0.9818	137	0.9066	0.9271	0.9168	0.9837
0.0086	47.0	4512	0.0598	0.8571	0.9574	0.9045	94	0.8929	0.8982	0.8955	167	0.9781	0.9781	0.9781	137	0.9122	0.9397	0.9257	0.9848
0.0088	48.0	4608	0.0569	0.8788	0.9255	0.9016	94	0.8929	0.8982	0.8955	167	0.9781	0.9781	0.9781	137	0.9183	0.9322	0.9252	0.9845
0.0079	49.0	4704	0.0570	0.8738	0.9574	0.9137	94	0.9	0.9162	0.9080	167	0.9781	0.9781	0.9781	137	0.9195	0.9472	0.9332	0.9854
0.008	50.0	4800	0.0592	0.8544	0.9362	0.8934	94	0.9030	0.8922	0.8976	167	0.9712	0.9854	0.9783	137	0.9140	0.9347	0.9242	0.9837
0.0075	51.0	4896	0.0636	0.8462	0.9362	0.8889	94	0.9241	0.8743	0.8985	167	0.9783	0.9854	0.9818	137	0.9225	0.9271	0.9248	0.9840
0.0065	52.0	4992	0.0522	0.8911	0.9574	0.9231	94	0.9053	0.9162	0.9107	167	0.9783	0.9854	0.9818	137	0.9265	0.9497	0.9380	0.9881
0.0059	53.0	5088	0.0700	0.8396	0.9468	0.89	94	0.9141	0.8922	0.9030	167	0.9712	0.9854	0.9783	137	0.9142	0.9372	0.9256	0.9831
0.0061	54.0	5184	0.0684	0.8544	0.9362	0.8934	94	0.8701	0.9222	0.8953	167	0.9779	0.9708	0.9744	137	0.9014	0.9422	0.9214	0.9840
0.0075	55.0	5280	0.0515	0.8990	0.9468	0.9223	94	0.9107	0.9162	0.9134	167	0.9712	0.9854	0.9783	137	0.9286	0.9472	0.9378	0.9870
0.0067	56.0	5376	0.0545	0.89	0.9468	0.9175	94	0.8908	0.9281	0.9091	167	0.9781	0.9781	0.9781	137	0.9197	0.9497	0.9345	0.9862
0.0068	57.0	5472	0.0620	0.8725	0.9468	0.9082	94	0.8895	0.9162	0.9027	167	0.9781	0.9781	0.9781	137	0.9148	0.9447	0.9295	0.9859
0.0064	58.0	5568	0.0645	0.8558	0.9468	0.8990	94	0.8941	0.9102	0.9021	167	0.9854	0.9854	0.9854	137	0.9148	0.9447	0.9295	0.9845
0.0081	59.0	5664	0.0579	0.8627	0.9362	0.8980	94	0.8909	0.8802	0.8855	167	0.9708	0.9708	0.9708	137	0.9109	0.9246	0.9177	0.9845
0.0047	60.0	5760	0.0560	0.8824	0.9574	0.9184	94	0.8862	0.8862	0.8862	167	0.9854	0.9854	0.9854	137	0.9187	0.9372	0.9279	0.9867
0.0051	61.0	5856	0.0563	0.8812	0.9468	0.9128	94	0.9042	0.9042	0.9042	167	0.9854	0.9854	0.9854	137	0.9259	0.9422	0.9340	0.9862
0.0047	62.0	5952	0.0566	0.8738	0.9574	0.9137	94	0.9130	0.8802	0.8963	167	0.9781	0.9781	0.9781	137	0.9252	0.9322	0.9287	0.9876
0.0048	63.0	6048	0.0556	0.875	0.9681	0.9192	94	0.9107	0.9162	0.9134	167	0.9781	0.9781	0.9781	137	0.9242	0.9497	0.9368	0.9870
0.0052	64.0	6144	0.0580	0.8911	0.9574	0.9231	94	0.9125	0.8743	0.8930	167	0.9781	0.9781	0.9781	137	0.9296	0.9296	0.9296	0.9878
0.0043	65.0	6240	0.0596	0.8812	0.9468	0.9128	94	0.9006	0.8683	0.8841	167	0.9781	0.9781	0.9781	137	0.9223	0.9246	0.9235	0.9862
0.0045	66.0	6336	0.0550	0.8911	0.9574	0.9231	94	0.8941	0.9102	0.9021	167	0.9926	0.9854	0.9890	137	0.9263	0.9472	0.9366	0.9873
0.0055	67.0	6432	0.0650	0.87	0.9255	0.8969	94	0.8908	0.9281	0.9091	167	0.9854	0.9854	0.9854	137	0.9173	0.9472	0.9320	0.9859
0.0044	68.0	6528	0.0656	0.8614	0.9255	0.8923	94	0.8929	0.8982	0.8955	167	0.9926	0.9854	0.9890	137	0.9185	0.9347	0.9265	0.9851
0.0043	69.0	6624	0.0586	0.8990	0.9468	0.9223	94	0.8941	0.9102	0.9021	167	0.9926	0.9854	0.9890	137	0.9284	0.9447	0.9365	0.9867
0.0047	70.0	6720	0.0600	0.88	0.9362	0.9072	94	0.9146	0.8982	0.9063	167	0.9926	0.9854	0.9890	137	0.9325	0.9372	0.9348	0.9862
0.0039	71.0	6816	0.0705	0.8544	0.9362	0.8934	94	0.8882	0.9042	0.8961	167	0.9854	0.9854	0.9854	137	0.9122	0.9397	0.9257	0.9848
0.0052	72.0	6912	0.0639	0.8713	0.9362	0.9026	94	0.8889	0.9102	0.8994	167	0.9926	0.9854	0.9890	137	0.9191	0.9422	0.9305	0.9859
0.0049	73.0	7008	0.0575	0.8922	0.9681	0.9286	94	0.9157	0.9102	0.9129	167	0.9926	0.9854	0.9890	137	0.9356	0.9497	0.9426	0.9887
0.0046	74.0	7104	0.0575	0.8911	0.9574	0.9231	94	0.9048	0.9102	0.9075	167	0.9926	0.9854	0.9890	137	0.9309	0.9472	0.9390	0.9876
0.0038	75.0	7200	0.0606	0.8812	0.9468	0.9128	94	0.9042	0.9042	0.9042	167	0.9781	0.9781	0.9781	137	0.9235	0.9397	0.9315	0.9862
0.0044	76.0	7296	0.0588	0.8889	0.9362	0.9119	94	0.9096	0.9042	0.9069	167	0.9781	0.9781	0.9781	137	0.9279	0.9372	0.9325	0.9862
0.0035	77.0	7392	0.0580	0.9020	0.9787	0.9388	94	0.9212	0.9102	0.9157	167	0.9781	0.9781	0.9781	137	0.9356	0.9497	0.9426	0.9876
0.0038	78.0	7488	0.0585	0.9	0.9574	0.9278	94	0.9202	0.8982	0.9091	167	0.9781	0.9781	0.9781	137	0.935	0.9397	0.9373	0.9867
0.0044	79.0	7584	0.0628	0.89	0.9468	0.9175	94	0.8895	0.9162	0.9027	167	0.9781	0.9781	0.9781	137	0.9193	0.9447	0.9318	0.9862
0.0035	80.0	7680	0.0628	0.88	0.9362	0.9072	94	0.8743	0.9162	0.8947	167	0.9781	0.9781	0.9781	137	0.9102	0.9422	0.9259	0.9856
0.0029	81.0	7776	0.0658	0.8558	0.9468	0.8990	94	0.8882	0.9042	0.8961	167	0.9710	0.9781	0.9745	137	0.9078	0.9397	0.9235	0.9848
0.0024	82.0	7872	0.0574	0.8990	0.9468	0.9223	94	0.875	0.9222	0.8980	167	0.9708	0.9708	0.9708	137	0.9126	0.9447	0.9284	0.9862
0.0041	83.0	7968	0.0613	0.88	0.9362	0.9072	94	0.9048	0.9102	0.9075	167	0.9926	0.9854	0.9890	137	0.9282	0.9422	0.9352	0.9856
0.0041	84.0	8064	0.0559	0.8824	0.9574	0.9184	94	0.9102	0.9102	0.9102	167	0.9781	0.9781	0.9781	137	0.9261	0.9447	0.9353	0.9870
0.0035	85.0	8160	0.0533	0.9082	0.9468	0.9271	94	0.9321	0.9042	0.9179	167	0.9781	0.9781	0.9781	137	0.9421	0.9397	0.9409	0.9878
0.003	86.0	8256	0.0551	0.8835	0.9681	0.9239	94	0.9096	0.9042	0.9069	167	0.9781	0.9781	0.9781	137	0.9261	0.9447	0.9353	0.9876
0.0036	87.0	8352	0.0583	0.8824	0.9574	0.9184	94	0.8994	0.9102	0.9048	167	0.9781	0.9781	0.9781	137	0.9216	0.9447	0.9330	0.9862
0.0029	88.0	8448	0.0542	0.8824	0.9574	0.9184	94	0.9	0.9162	0.9080	167	0.9781	0.9781	0.9781	137	0.9218	0.9472	0.9343	0.9867
0.0025	89.0	8544	0.0624	0.8654	0.9574	0.9091	94	0.9091	0.8982	0.9036	167	0.9781	0.9781	0.9781	137	0.9212	0.9397	0.9303	0.9862
0.0026	90.0	8640	0.0577	0.8812	0.9468	0.9128	94	0.9212	0.9102	0.9157	167	0.9781	0.9781	0.9781	137	0.9305	0.9422	0.9363	0.9873
0.003	91.0	8736	0.0582	0.8738	0.9574	0.9137	94	0.8786	0.9102	0.8941	167	0.9926	0.9854	0.9890	137	0.9150	0.9472	0.9309	0.9862
0.0029	92.0	8832	0.0570	0.8738	0.9574	0.9137	94	0.8941	0.9102	0.9021	167	0.9781	0.9781	0.9781	137	0.9171	0.9447	0.9307	0.9870
0.0039	93.0	8928	0.0583	0.8835	0.9681	0.9239	94	0.9036	0.8982	0.9009	167	0.9926	0.9854	0.9890	137	0.9284	0.9447	0.9365	0.9867
0.0034	94.0	9024	0.0584	0.8641	0.9468	0.9036	94	0.8889	0.9102	0.8994	167	0.9781	0.9781	0.9781	137	0.9124	0.9422	0.9271	0.9867
0.0024	95.0	9120	0.0588	0.8738	0.9574	0.9137	94	0.9152	0.9042	0.9096	167	0.9781	0.9781	0.9781	137	0.9259	0.9422	0.9340	0.9873
0.0034	96.0	9216	0.0598	0.8641	0.9468	0.9036	94	0.8824	0.8982	0.8902	167	0.9781	0.9781	0.9781	137	0.9098	0.9372	0.9233	0.9856
0.003	97.0	9312	0.0613	0.8738	0.9574	0.9137	94	0.8876	0.8982	0.8929	167	0.9708	0.9708	0.9708	137	0.9120	0.9372	0.9244	0.9854
0.0027	98.0	9408	0.0602	0.8738	0.9574	0.9137	94	0.8988	0.9042	0.9015	167	0.9781	0.9781	0.9781	137	0.9191	0.9422	0.9305	0.9865
0.0023	99.0	9504	0.0590	0.8738	0.9574	0.9137	94	0.8994	0.9102	0.9048	167	0.9781	0.9781	0.9781	137	0.9193	0.9447	0.9318	0.9867
0.0024	100.0	9600	0.0592	0.8738	0.9574	0.9137	94	0.8994	0.9102	0.9048	167	0.9781	0.9781	0.9781	137	0.9193	0.9447	0.9318	0.9867

Framework versions

• Transformers 4.39.3
• Pytorch 2.3.0+cu121
• Datasets 2.19.1
• Tokenizers 0.15.2