ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k9_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1965
• Qwk: 0.5801
• Mse: 1.1965
• Rmse: 1.0938

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0556	2	2.0835	0.0327	2.0835	1.4434
No log	0.1111	4	1.3183	0.2531	1.3183	1.1482
No log	0.1667	6	1.5311	0.1569	1.5311	1.2374
No log	0.2222	8	1.7324	0.3176	1.7324	1.3162
No log	0.2778	10	1.7510	0.2971	1.7510	1.3232
No log	0.3333	12	1.6558	0.3289	1.6558	1.2868
No log	0.3889	14	1.5227	0.1518	1.5227	1.2340
No log	0.4444	16	1.4441	0.1283	1.4441	1.2017
No log	0.5	18	1.4014	0.1528	1.4014	1.1838
No log	0.5556	20	1.3758	0.1236	1.3758	1.1729
No log	0.6111	22	1.4096	0.2031	1.4096	1.1873
No log	0.6667	24	1.4173	0.2035	1.4173	1.1905
No log	0.7222	26	1.4022	0.1899	1.4022	1.1842
No log	0.7778	28	1.4202	0.2168	1.4202	1.1917
No log	0.8333	30	1.4873	0.3078	1.4873	1.2196
No log	0.8889	32	1.5120	0.3103	1.5120	1.2296
No log	0.9444	34	1.4930	0.3333	1.4930	1.2219
No log	1.0	36	1.2993	0.3001	1.2993	1.1399
No log	1.0556	38	1.1986	0.3022	1.1986	1.0948
No log	1.1111	40	1.1816	0.3508	1.1816	1.0870
No log	1.1667	42	1.2010	0.3402	1.2010	1.0959
No log	1.2222	44	1.3006	0.3974	1.3006	1.1404
No log	1.2778	46	1.3338	0.3918	1.3338	1.1549
No log	1.3333	48	1.2526	0.3808	1.2526	1.1192
No log	1.3889	50	1.2328	0.3971	1.2328	1.1103
No log	1.4444	52	1.1658	0.4150	1.1658	1.0797
No log	1.5	54	1.1080	0.3977	1.1080	1.0526
No log	1.5556	56	1.1594	0.4438	1.1594	1.0768
No log	1.6111	58	1.2714	0.4606	1.2714	1.1276
No log	1.6667	60	1.6315	0.4325	1.6315	1.2773
No log	1.7222	62	1.8417	0.3969	1.8417	1.3571
No log	1.7778	64	1.7018	0.4174	1.7018	1.3045
No log	1.8333	66	1.4697	0.4419	1.4697	1.2123
No log	1.8889	68	1.3170	0.3955	1.3170	1.1476
No log	1.9444	70	1.1623	0.3846	1.1623	1.0781
No log	2.0	72	1.1438	0.4401	1.1438	1.0695
No log	2.0556	74	1.2532	0.4573	1.2532	1.1195
No log	2.1111	76	1.5598	0.4488	1.5598	1.2489
No log	2.1667	78	1.6084	0.4480	1.6084	1.2682
No log	2.2222	80	1.3584	0.4393	1.3584	1.1655
No log	2.2778	82	1.1962	0.5236	1.1962	1.0937
No log	2.3333	84	1.2070	0.4919	1.2070	1.0986
No log	2.3889	86	1.3559	0.4836	1.3559	1.1644
No log	2.4444	88	1.5679	0.4069	1.5679	1.2521
No log	2.5	90	1.5896	0.3876	1.5896	1.2608
No log	2.5556	92	1.4506	0.4331	1.4506	1.2044
No log	2.6111	94	1.3773	0.4615	1.3773	1.1736
No log	2.6667	96	1.4564	0.4408	1.4564	1.2068
No log	2.7222	98	1.5535	0.4445	1.5535	1.2464
No log	2.7778	100	1.4760	0.4600	1.4760	1.2149
No log	2.8333	102	1.3131	0.5042	1.3131	1.1459
No log	2.8889	104	1.2071	0.5180	1.2071	1.0987
No log	2.9444	106	1.4016	0.5428	1.4016	1.1839
No log	3.0	108	1.9828	0.4442	1.9828	1.4081
No log	3.0556	110	2.1416	0.4137	2.1416	1.4634
No log	3.1111	112	1.8108	0.4459	1.8108	1.3457
No log	3.1667	114	1.2645	0.5433	1.2645	1.1245
No log	3.2222	116	1.0916	0.5781	1.0916	1.0448
No log	3.2778	118	1.2201	0.5614	1.2201	1.1046
No log	3.3333	120	1.4672	0.5090	1.4672	1.2113
No log	3.3889	122	1.4516	0.5326	1.4516	1.2048
No log	3.4444	124	1.3008	0.5497	1.3008	1.1405
No log	3.5	126	1.1760	0.5791	1.1760	1.0844
No log	3.5556	128	1.1012	0.6099	1.1012	1.0494
No log	3.6111	130	0.9997	0.6136	0.9997	0.9998
No log	3.6667	132	1.0527	0.5854	1.0527	1.0260
No log	3.7222	134	1.1957	0.5116	1.1957	1.0935
No log	3.7778	136	1.3981	0.4928	1.3981	1.1824
No log	3.8333	138	1.5145	0.4908	1.5145	1.2307
No log	3.8889	140	1.3979	0.5306	1.3979	1.1823
No log	3.9444	142	1.3268	0.5670	1.3268	1.1519
No log	4.0	144	1.4287	0.5512	1.4287	1.1953
No log	4.0556	146	1.6224	0.5389	1.6224	1.2737
No log	4.1111	148	1.5698	0.5431	1.5698	1.2529
No log	4.1667	150	1.2468	0.5868	1.2468	1.1166
No log	4.2222	152	0.9850	0.5920	0.9850	0.9925
No log	4.2778	154	0.9818	0.5827	0.9818	0.9909
No log	4.3333	156	1.1434	0.5334	1.1434	1.0693
No log	4.3889	158	1.4092	0.4934	1.4092	1.1871
No log	4.4444	160	1.4816	0.4763	1.4816	1.2172
No log	4.5	162	1.3459	0.5269	1.3459	1.1601
No log	4.5556	164	1.2974	0.5354	1.2974	1.1391
No log	4.6111	166	1.2331	0.5648	1.2331	1.1104
No log	4.6667	168	1.1632	0.5677	1.1632	1.0785
No log	4.7222	170	1.1191	0.5699	1.1191	1.0579
No log	4.7778	172	1.1182	0.5872	1.1182	1.0574
No log	4.8333	174	1.2469	0.5802	1.2469	1.1166
No log	4.8889	176	1.3368	0.5205	1.3368	1.1562
No log	4.9444	178	1.2523	0.5648	1.2523	1.1191
No log	5.0	180	1.0276	0.5991	1.0276	1.0137
No log	5.0556	182	0.8862	0.5987	0.8862	0.9414
No log	5.1111	184	0.8861	0.5819	0.8861	0.9414
No log	5.1667	186	0.9859	0.6123	0.9859	0.9929
No log	5.2222	188	1.1444	0.5911	1.1444	1.0698
No log	5.2778	190	1.2145	0.5961	1.2145	1.1020
No log	5.3333	192	1.1789	0.6030	1.1789	1.0858
No log	5.3889	194	1.1460	0.6197	1.1460	1.0705
No log	5.4444	196	1.1430	0.6328	1.1430	1.0691
No log	5.5	198	1.2288	0.5824	1.2288	1.1085
No log	5.5556	200	1.3429	0.5385	1.3429	1.1589
No log	5.6111	202	1.2091	0.5956	1.2091	1.0996
No log	5.6667	204	1.0448	0.6539	1.0448	1.0221
No log	5.7222	206	0.9476	0.6479	0.9476	0.9735
No log	5.7778	208	0.9663	0.6664	0.9663	0.9830
No log	5.8333	210	1.0456	0.6060	1.0456	1.0226
No log	5.8889	212	1.1136	0.5990	1.1136	1.0553
No log	5.9444	214	1.1388	0.5990	1.1388	1.0671
No log	6.0	216	1.0920	0.6337	1.0920	1.0450
No log	6.0556	218	1.0392	0.6506	1.0392	1.0194
No log	6.1111	220	1.1146	0.6489	1.1146	1.0558
No log	6.1667	222	1.3049	0.6134	1.3049	1.1423
No log	6.2222	224	1.5299	0.5619	1.5299	1.2369
No log	6.2778	226	1.5593	0.5526	1.5593	1.2487
No log	6.3333	228	1.4191	0.5644	1.4191	1.1912
No log	6.3889	230	1.2130	0.5879	1.2130	1.1013
No log	6.4444	232	1.1631	0.6287	1.1631	1.0785
No log	6.5	234	1.2092	0.5961	1.2092	1.0996
No log	6.5556	236	1.1831	0.5748	1.1831	1.0877
No log	6.6111	238	1.1118	0.5836	1.1118	1.0544
No log	6.6667	240	1.0750	0.5937	1.0750	1.0368
No log	6.7222	242	1.0341	0.6207	1.0341	1.0169
No log	6.7778	244	1.0538	0.6209	1.0538	1.0265
No log	6.8333	246	1.1444	0.5868	1.1444	1.0698
No log	6.8889	248	1.2881	0.5678	1.2881	1.1350
No log	6.9444	250	1.3406	0.5541	1.3406	1.1578
No log	7.0	252	1.2836	0.5788	1.2836	1.1330
No log	7.0556	254	1.1285	0.5923	1.1285	1.0623
No log	7.1111	256	1.0611	0.6082	1.0611	1.0301
No log	7.1667	258	1.0620	0.6064	1.0620	1.0305
No log	7.2222	260	1.1375	0.5935	1.1375	1.0665
No log	7.2778	262	1.2506	0.5716	1.2506	1.1183
No log	7.3333	264	1.2705	0.5706	1.2705	1.1272
No log	7.3889	266	1.2504	0.5716	1.2504	1.1182
No log	7.4444	268	1.1839	0.5899	1.1839	1.0881
No log	7.5	270	1.0846	0.6033	1.0846	1.0415
No log	7.5556	272	1.0598	0.6014	1.0598	1.0295
No log	7.6111	274	1.0271	0.6288	1.0271	1.0135
No log	7.6667	276	0.9956	0.6267	0.9956	0.9978
No log	7.7222	278	1.0047	0.6288	1.0047	1.0023
No log	7.7778	280	1.0411	0.6288	1.0411	1.0204
No log	7.8333	282	1.0983	0.6160	1.0983	1.0480
No log	7.8889	284	1.1594	0.5954	1.1594	1.0767
No log	7.9444	286	1.1853	0.5954	1.1853	1.0887
No log	8.0	288	1.2138	0.5831	1.2138	1.1017
No log	8.0556	290	1.2065	0.5842	1.2065	1.0984
No log	8.1111	292	1.1827	0.5972	1.1827	1.0875
No log	8.1667	294	1.1190	0.6120	1.1190	1.0579
No log	8.2222	296	1.0602	0.6239	1.0602	1.0297
No log	8.2778	298	1.0596	0.6332	1.0596	1.0294
No log	8.3333	300	1.0959	0.6224	1.0959	1.0468
No log	8.3889	302	1.1562	0.5923	1.1562	1.0752
No log	8.4444	304	1.2285	0.5524	1.2285	1.1084
No log	8.5	306	1.2866	0.5309	1.2866	1.1343
No log	8.5556	308	1.3253	0.5267	1.3253	1.1512
No log	8.6111	310	1.3071	0.5239	1.3071	1.1433
No log	8.6667	312	1.2475	0.5225	1.2475	1.1169
No log	8.7222	314	1.1684	0.5624	1.1684	1.0809
No log	8.7778	316	1.1274	0.5759	1.1274	1.0618
No log	8.8333	318	1.1187	0.5759	1.1187	1.0577
No log	8.8889	320	1.1401	0.5759	1.1401	1.0678
No log	8.9444	322	1.1517	0.5736	1.1517	1.0732
No log	9.0	324	1.1632	0.5658	1.1632	1.0785
No log	9.0556	326	1.1841	0.5661	1.1841	1.0882
No log	9.1111	328	1.2090	0.5661	1.2090	1.0995
No log	9.1667	330	1.2208	0.5684	1.2208	1.1049
No log	9.2222	332	1.2095	0.5684	1.2095	1.0998
No log	9.2778	334	1.1929	0.5684	1.1929	1.0922
No log	9.3333	336	1.1856	0.5801	1.1856	1.0888
No log	9.3889	338	1.1876	0.5801	1.1876	1.0898
No log	9.4444	340	1.1869	0.5801	1.1869	1.0894
No log	9.5	342	1.1976	0.5684	1.1976	1.0943
No log	9.5556	344	1.2009	0.5684	1.2009	1.0959
No log	9.6111	346	1.2029	0.5684	1.2029	1.0968
No log	9.6667	348	1.2031	0.5548	1.2031	1.0969
No log	9.7222	350	1.2072	0.5548	1.2072	1.0987
No log	9.7778	352	1.2014	0.5821	1.2014	1.0961
No log	9.8333	354	1.1987	0.5801	1.1987	1.0949
No log	9.8889	356	1.1995	0.5801	1.1995	1.0952
No log	9.9444	358	1.1976	0.5801	1.1976	1.0943
No log	10.0	360	1.1965	0.5801	1.1965	1.0938

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1