ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k6_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2457
• Qwk: 0.1928
• Mse: 1.2457
• Rmse: 1.1161

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0690	2	4.6184	0.0010	4.6184	2.1491
No log	0.1379	4	2.6803	0.0066	2.6803	1.6371
No log	0.2069	6	1.9590	-0.0303	1.9590	1.3996
No log	0.2759	8	1.9539	0.0389	1.9539	1.3978
No log	0.3448	10	1.7450	-0.0969	1.7450	1.3210
No log	0.4138	12	1.4571	-0.0479	1.4571	1.2071
No log	0.4828	14	1.4289	-0.0159	1.4289	1.1954
No log	0.5517	16	1.7184	0.0560	1.7184	1.3109
No log	0.6207	18	2.4362	-0.0436	2.4362	1.5608
No log	0.6897	20	2.3879	0.0258	2.3879	1.5453
No log	0.7586	22	1.5328	0.1364	1.5328	1.2381
No log	0.8276	24	1.2350	0.2567	1.2350	1.1113
No log	0.8966	26	1.2326	0.2372	1.2326	1.1102
No log	0.9655	28	1.4322	0.1928	1.4322	1.1967
No log	1.0345	30	1.5566	0.1768	1.5566	1.2477
No log	1.1034	32	1.7714	0.1906	1.7714	1.3309
No log	1.1724	34	1.9392	0.1268	1.9392	1.3925
No log	1.2414	36	1.7200	0.1929	1.7200	1.3115
No log	1.3103	38	1.4014	0.2384	1.4014	1.1838
No log	1.3793	40	1.2338	0.2005	1.2338	1.1108
No log	1.4483	42	1.2398	0.2337	1.2398	1.1135
No log	1.5172	44	1.4091	0.1493	1.4091	1.1870
No log	1.5862	46	1.7481	0.2051	1.7481	1.3222
No log	1.6552	48	1.8322	0.1597	1.8322	1.3536
No log	1.7241	50	1.5803	0.2459	1.5803	1.2571
No log	1.7931	52	1.2249	0.2577	1.2249	1.1067
No log	1.8621	54	1.1747	0.3106	1.1747	1.0838
No log	1.9310	56	1.3551	0.1801	1.3551	1.1641
No log	2.0	58	1.7476	0.2007	1.7476	1.3220
No log	2.0690	60	2.3008	0.0980	2.3008	1.5168
No log	2.1379	62	2.0106	0.1119	2.0106	1.4179
No log	2.2069	64	1.3229	0.2062	1.3229	1.1502
No log	2.2759	66	1.0947	0.2100	1.0947	1.0463
No log	2.3448	68	1.1107	0.1886	1.1107	1.0539
No log	2.4138	70	1.1149	0.2662	1.1149	1.0559
No log	2.4828	72	1.2549	0.1821	1.2549	1.1202
No log	2.5517	74	1.6187	0.0733	1.6187	1.2723
No log	2.6207	76	1.9953	0.1379	1.9953	1.4125
No log	2.6897	78	2.0051	0.1373	2.0051	1.4160
No log	2.7586	80	1.7063	0.1569	1.7063	1.3063
No log	2.8276	82	1.3897	0.1718	1.3897	1.1789
No log	2.8966	84	1.2598	0.2451	1.2598	1.1224
No log	2.9655	86	1.1253	0.2851	1.1253	1.0608
No log	3.0345	88	1.1109	0.3134	1.1109	1.0540
No log	3.1034	90	1.0897	0.2944	1.0897	1.0439
No log	3.1724	92	1.1497	0.2593	1.1497	1.0723
No log	3.2414	94	1.1752	0.2891	1.1752	1.0841
No log	3.3103	96	1.1984	0.3033	1.1984	1.0947
No log	3.3793	98	1.5070	0.3024	1.5070	1.2276
No log	3.4483	100	1.6723	0.2459	1.6723	1.2932
No log	3.5172	102	1.3970	0.2292	1.3970	1.1819
No log	3.5862	104	1.1623	0.2210	1.1623	1.0781
No log	3.6552	106	1.1342	0.2394	1.1342	1.0650
No log	3.7241	108	1.1292	0.2966	1.1292	1.0627
No log	3.7931	110	1.1510	0.2410	1.1510	1.0728
No log	3.8621	112	1.2910	0.2585	1.2910	1.1362
No log	3.9310	114	1.4748	0.1630	1.4748	1.2144
No log	4.0	116	1.4755	0.1630	1.4755	1.2147
No log	4.0690	118	1.3290	0.1964	1.3290	1.1528
No log	4.1379	120	1.3598	0.1742	1.3598	1.1661
No log	4.2069	122	1.5833	0.2399	1.5833	1.2583
No log	4.2759	124	1.4856	0.1840	1.4856	1.2189
No log	4.3448	126	1.2807	0.0861	1.2807	1.1317
No log	4.4138	128	1.2130	0.2658	1.2130	1.1014
No log	4.4828	130	1.1957	0.2134	1.1957	1.0935
No log	4.5517	132	1.2289	0.0686	1.2289	1.1086
No log	4.6207	134	1.4322	0.2239	1.4322	1.1968
No log	4.6897	136	1.4867	0.1649	1.4867	1.2193
No log	4.7586	138	1.3157	0.1447	1.3157	1.1470
No log	4.8276	140	1.2706	0.0571	1.2706	1.1272
No log	4.8966	142	1.2813	0.0582	1.2813	1.1319
No log	4.9655	144	1.2916	0.0881	1.2916	1.1365
No log	5.0345	146	1.2952	0.1697	1.2952	1.1381
No log	5.1034	148	1.3493	0.2040	1.3493	1.1616
No log	5.1724	150	1.5351	0.1198	1.5351	1.2390
No log	5.2414	152	1.6832	0.1908	1.6832	1.2974
No log	5.3103	154	1.5849	0.1551	1.5849	1.2589
No log	5.3793	156	1.3771	0.2232	1.3771	1.1735
No log	5.4483	158	1.2692	0.1355	1.2692	1.1266
No log	5.5172	160	1.2976	0.1640	1.2976	1.1391
No log	5.5862	162	1.4201	0.2180	1.4201	1.1917
No log	5.6552	164	1.5252	0.1871	1.5252	1.2350
No log	5.7241	166	1.3959	0.2524	1.3959	1.1815
No log	5.7931	168	1.2862	0.2103	1.2862	1.1341
No log	5.8621	170	1.3056	0.2233	1.3056	1.1426
No log	5.9310	172	1.4287	0.2255	1.4287	1.1953
No log	6.0	174	1.4444	0.2484	1.4444	1.2018
No log	6.0690	176	1.4200	0.1957	1.4200	1.1916
No log	6.1379	178	1.3320	0.2293	1.3320	1.1541
No log	6.2069	180	1.2818	0.1728	1.2818	1.1321
No log	6.2759	182	1.2811	0.1977	1.2811	1.1319
No log	6.3448	184	1.3277	0.2431	1.3277	1.1523
No log	6.4138	186	1.3624	0.2418	1.3624	1.1672
No log	6.4828	188	1.5841	0.0938	1.5841	1.2586
No log	6.5517	190	1.5905	0.0907	1.5905	1.2611
No log	6.6207	192	1.3817	0.1291	1.3817	1.1755
No log	6.6897	194	1.3080	0.1118	1.3080	1.1437
No log	6.7586	196	1.3407	0.1489	1.3407	1.1579
No log	6.8276	198	1.4287	0.1965	1.4287	1.1953
No log	6.8966	200	1.4100	0.1914	1.4100	1.1875
No log	6.9655	202	1.3462	0.1317	1.3462	1.1602
No log	7.0345	204	1.3565	0.1820	1.3565	1.1647
No log	7.1034	206	1.3759	0.1958	1.3759	1.1730
No log	7.1724	208	1.3111	0.1852	1.3111	1.1450
No log	7.2414	210	1.2799	0.1412	1.2799	1.1313
No log	7.3103	212	1.3272	0.1898	1.3272	1.1521
No log	7.3793	214	1.4687	0.1510	1.4687	1.2119
No log	7.4483	216	1.4083	0.1820	1.4083	1.1867
No log	7.5172	218	1.3133	0.1943	1.3133	1.1460
No log	7.5862	220	1.3147	0.1792	1.3147	1.1466
No log	7.6552	222	1.3839	0.2100	1.3839	1.1764
No log	7.7241	224	1.5793	0.1718	1.5793	1.2567
No log	7.7931	226	1.5161	0.1801	1.5161	1.2313
No log	7.8621	228	1.3552	0.2320	1.3552	1.1641
No log	7.9310	230	1.3249	0.1626	1.3249	1.1510
No log	8.0	232	1.3917	0.2122	1.3917	1.1797
No log	8.0690	234	1.3802	0.1590	1.3802	1.1748
No log	8.1379	236	1.3645	0.1681	1.3645	1.1681
No log	8.2069	238	1.4316	0.1852	1.4316	1.1965
No log	8.2759	240	1.5372	0.2339	1.5372	1.2399
No log	8.3448	242	1.6454	0.1018	1.6454	1.2827
No log	8.4138	244	1.6238	0.0677	1.6238	1.2743
No log	8.4828	246	1.4274	0.1751	1.4274	1.1948
No log	8.5517	248	1.3466	0.1598	1.3466	1.1604
No log	8.6207	250	1.3458	0.1586	1.3458	1.1601
No log	8.6897	252	1.4062	0.1557	1.4062	1.1858
No log	8.7586	254	1.4507	0.1557	1.4507	1.2044
No log	8.8276	256	1.4288	0.2249	1.4288	1.1953
No log	8.8966	258	1.4941	0.1015	1.4941	1.2223
No log	8.9655	260	1.5531	0.1314	1.5531	1.2462
No log	9.0345	262	1.5846	0.1075	1.5846	1.2588
No log	9.1034	264	1.4668	0.1538	1.4668	1.2111
No log	9.1724	266	1.4024	0.1882	1.4024	1.1842
No log	9.2414	268	1.3655	0.2605	1.3655	1.1686
No log	9.3103	270	1.4821	0.1084	1.4821	1.2174
No log	9.3793	272	1.4850	0.1200	1.4850	1.2186
No log	9.4483	274	1.3691	0.2270	1.3691	1.1701
No log	9.5172	276	1.3161	0.2159	1.3161	1.1472
No log	9.5862	278	1.3079	0.2058	1.3079	1.1437
No log	9.6552	280	1.3092	0.2058	1.3092	1.1442
No log	9.7241	282	1.3126	0.1674	1.3126	1.1457
No log	9.7931	284	1.3419	0.1898	1.3419	1.1584
No log	9.8621	286	1.3325	0.1898	1.3325	1.1544
No log	9.9310	288	1.3626	0.1898	1.3626	1.1673
No log	10.0	290	1.5480	0.1341	1.5480	1.2442
No log	10.0690	292	1.6983	0.1475	1.6983	1.3032
No log	10.1379	294	1.5787	0.1652	1.5787	1.2565
No log	10.2069	296	1.4190	0.1855	1.4190	1.1912
No log	10.2759	298	1.3898	0.2058	1.3898	1.1789
No log	10.3448	300	1.3484	0.2974	1.3484	1.1612
No log	10.4138	302	1.3698	0.2188	1.3698	1.1704
No log	10.4828	304	1.5344	0.1151	1.5344	1.2387
No log	10.5517	306	1.5820	0.0966	1.5820	1.2578
No log	10.6207	308	1.3838	0.1809	1.3838	1.1764
No log	10.6897	310	1.2634	0.1737	1.2634	1.1240
No log	10.7586	312	1.2606	0.1737	1.2606	1.1228
No log	10.8276	314	1.2382	0.2159	1.2382	1.1128
No log	10.8966	316	1.2278	0.2249	1.2278	1.1081
No log	10.9655	318	1.2449	0.2159	1.2449	1.1158
No log	11.0345	320	1.3513	0.1943	1.3513	1.1625
No log	11.1034	322	1.3924	0.1606	1.3924	1.1800
No log	11.1724	324	1.4865	0.2090	1.4865	1.2192
No log	11.2414	326	1.4305	0.2412	1.4305	1.1960
No log	11.3103	328	1.3162	0.2344	1.3162	1.1472
No log	11.3793	330	1.2464	0.2261	1.2464	1.1164
No log	11.4483	332	1.1910	0.2539	1.1910	1.0913
No log	11.5172	334	1.1812	0.2261	1.1812	1.0868
No log	11.5862	336	1.2023	0.2261	1.2023	1.0965
No log	11.6552	338	1.1837	0.2261	1.1837	1.0880
No log	11.7241	340	1.1864	0.2261	1.1864	1.0892
No log	11.7931	342	1.1944	0.2637	1.1944	1.0929
No log	11.8621	344	1.2628	0.2768	1.2628	1.1238
No log	11.9310	346	1.2342	0.2714	1.2342	1.1109
No log	12.0	348	1.2031	0.2348	1.2031	1.0968
No log	12.0690	350	1.2335	0.2348	1.2335	1.1106
No log	12.1379	352	1.3087	0.3050	1.3087	1.1440
No log	12.2069	354	1.2996	0.3050	1.2996	1.1400
No log	12.2759	356	1.1618	0.2371	1.1618	1.0779
No log	12.3448	358	1.1140	0.1921	1.1140	1.0555
No log	12.4138	360	1.1267	0.2210	1.1267	1.0615
No log	12.4828	362	1.2638	0.3280	1.2638	1.1242
No log	12.5517	364	1.3491	0.3005	1.3491	1.1615
No log	12.6207	366	1.2612	0.2170	1.2612	1.1230
No log	12.6897	368	1.1925	0.2820	1.1925	1.0920
No log	12.7586	370	1.2471	0.2612	1.2471	1.1168
No log	12.8276	372	1.2328	0.2230	1.2328	1.1103
No log	12.8966	374	1.2431	0.2340	1.2431	1.1149
No log	12.9655	376	1.3335	0.2170	1.3335	1.1548
No log	13.0345	378	1.4260	0.1204	1.4260	1.1942
No log	13.1034	380	1.3663	0.2170	1.3663	1.1689
No log	13.1724	382	1.2363	0.2539	1.2363	1.1119
No log	13.2414	384	1.1990	0.2009	1.1990	1.0950
No log	13.3103	386	1.1964	0.2198	1.1964	1.0938
No log	13.3793	388	1.2233	0.2210	1.2233	1.1060
No log	13.4483	390	1.2931	0.2963	1.2931	1.1372
No log	13.5172	392	1.3354	0.2851	1.3354	1.1556
No log	13.5862	394	1.3661	0.2763	1.3661	1.1688
No log	13.6552	396	1.2775	0.3033	1.2775	1.1303
No log	13.7241	398	1.1681	0.2446	1.1681	1.0808
No log	13.7931	400	1.1420	0.2947	1.1420	1.0686
No log	13.8621	402	1.1657	0.2682	1.1657	1.0797
No log	13.9310	404	1.2813	0.2361	1.2813	1.1319
No log	14.0	406	1.3489	0.2141	1.3489	1.1614
No log	14.0690	408	1.2677	0.2273	1.2677	1.1259
No log	14.1379	410	1.1739	0.3174	1.1739	1.0835
No log	14.2069	412	1.1617	0.2346	1.1617	1.0778
No log	14.2759	414	1.1784	0.3174	1.1784	1.0856
No log	14.3448	416	1.2370	0.2403	1.2370	1.1122
No log	14.4138	418	1.2543	0.2403	1.2543	1.1200
No log	14.4828	420	1.2359	0.2403	1.2359	1.1117
No log	14.5517	422	1.2052	0.2403	1.2052	1.0978
No log	14.6207	424	1.1906	0.2403	1.1906	1.0912
No log	14.6897	426	1.2154	0.2654	1.2154	1.1024
No log	14.7586	428	1.2255	0.2796	1.2255	1.1070
No log	14.8276	430	1.1812	0.2654	1.1812	1.0869
No log	14.8966	432	1.1335	0.2169	1.1335	1.0647
No log	14.9655	434	1.1202	0.2740	1.1202	1.0584
No log	15.0345	436	1.1343	0.2620	1.1343	1.0650
No log	15.1034	438	1.1838	0.2403	1.1838	1.0880
No log	15.1724	440	1.1926	0.2403	1.1926	1.0921
No log	15.2414	442	1.1754	0.2896	1.1754	1.0841
No log	15.3103	444	1.1347	0.2446	1.1347	1.0652
No log	15.3793	446	1.1281	0.2302	1.1281	1.0621
No log	15.4483	448	1.1534	0.2075	1.1534	1.0740
No log	15.5172	450	1.2149	0.2685	1.2149	1.1022
No log	15.5862	452	1.2585	0.3226	1.2585	1.1218
No log	15.6552	454	1.2406	0.2964	1.2406	1.1138
No log	15.7241	456	1.2353	0.3052	1.2353	1.1114
No log	15.7931	458	1.3660	0.2181	1.3660	1.1688
No log	15.8621	460	1.4110	0.3184	1.4110	1.1879
No log	15.9310	462	1.3369	0.2181	1.3369	1.1563
No log	16.0	464	1.2233	0.2851	1.2233	1.1060
No log	16.0690	466	1.1932	0.2871	1.1932	1.0923
No log	16.1379	468	1.1615	0.2730	1.1615	1.0777
No log	16.2069	470	1.1419	0.2071	1.1419	1.0686
No log	16.2759	472	1.1304	0.2071	1.1304	1.0632
No log	16.3448	474	1.1362	0.1975	1.1362	1.0659
No log	16.4138	476	1.1621	0.1975	1.1621	1.0780
No log	16.4828	478	1.2206	0.1841	1.2206	1.1048
No log	16.5517	480	1.3236	0.1896	1.3236	1.1505
No log	16.6207	482	1.4113	0.2585	1.4113	1.1880
No log	16.6897	484	1.4195	0.1921	1.4195	1.1914
No log	16.7586	486	1.3569	0.2131	1.3569	1.1648
No log	16.8276	488	1.2372	0.2069	1.2372	1.1123
No log	16.8966	490	1.1984	0.2539	1.1984	1.0947
No log	16.9655	492	1.2186	0.2030	1.2186	1.1039
No log	17.0345	494	1.3059	0.2180	1.3059	1.1428
No log	17.1034	496	1.3025	0.2328	1.3025	1.1413
No log	17.1724	498	1.2441	0.2180	1.2441	1.1154
0.3384	17.2414	500	1.2218	0.2169	1.2218	1.1053
0.3384	17.3103	502	1.2645	0.2221	1.2645	1.1245
0.3384	17.3793	504	1.3805	0.1671	1.3805	1.1750
0.3384	17.4483	506	1.5986	0.1785	1.5986	1.2643
0.3384	17.5172	508	1.6366	0.1299	1.6366	1.2793
0.3384	17.5862	510	1.4492	0.1631	1.4492	1.2038
0.3384	17.6552	512	1.2457	0.1928	1.2457	1.1161

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1