ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k10_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1279
• Qwk: 0.3010
• Mse: 1.1279
• Rmse: 1.0620

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0392	2	4.7827	0.0010	4.7827	2.1869
No log	0.0784	4	2.9496	0.0093	2.9496	1.7174
No log	0.1176	6	2.0361	-0.0433	2.0361	1.4269
No log	0.1569	8	1.7813	0.0217	1.7813	1.3347
No log	0.1961	10	1.3530	0.1403	1.3530	1.1632
No log	0.2353	12	1.5556	0.0749	1.5556	1.2472
No log	0.2745	14	1.8703	0.0844	1.8703	1.3676
No log	0.3137	16	1.5348	0.0227	1.5348	1.2389
No log	0.3529	18	1.1567	0.1959	1.1567	1.0755
No log	0.3922	20	1.0685	0.2191	1.0685	1.0337
No log	0.4314	22	1.1334	0.2040	1.1334	1.0646
No log	0.4706	24	1.1672	0.2191	1.1672	1.0804
No log	0.5098	26	1.1501	0.2342	1.1501	1.0724
No log	0.5490	28	1.3736	0.1587	1.3736	1.1720
No log	0.5882	30	1.4644	0.2074	1.4644	1.2101
No log	0.6275	32	1.3441	0.2292	1.3441	1.1593
No log	0.6667	34	1.2735	0.2141	1.2735	1.1285
No log	0.7059	36	1.3913	0.2544	1.3913	1.1795
No log	0.7451	38	1.4450	0.2411	1.4450	1.2021
No log	0.7843	40	1.6728	0.1555	1.6728	1.2934
No log	0.8235	42	2.0733	0.1148	2.0733	1.4399
No log	0.8627	44	2.1126	0.1168	2.1126	1.4535
No log	0.9020	46	1.6806	0.2644	1.6806	1.2964
No log	0.9412	48	1.2266	0.2532	1.2266	1.1075
No log	0.9804	50	0.9696	0.3441	0.9696	0.9847
No log	1.0196	52	0.9303	0.3762	0.9303	0.9645
No log	1.0588	54	0.9245	0.3704	0.9245	0.9615
No log	1.0980	56	1.1336	0.2446	1.1336	1.0647
No log	1.1373	58	1.6728	0.2243	1.6728	1.2934
No log	1.1765	60	1.7550	0.2199	1.7550	1.3248
No log	1.2157	62	1.7609	0.2644	1.7609	1.3270
No log	1.2549	64	1.5482	0.2939	1.5482	1.2443
No log	1.2941	66	1.5359	0.2959	1.5359	1.2393
No log	1.3333	68	1.5170	0.2593	1.5170	1.2317
No log	1.3725	70	1.3397	0.1549	1.3397	1.1575
No log	1.4118	72	1.2613	0.1735	1.2613	1.1231
No log	1.4510	74	1.3359	0.2028	1.3359	1.1558
No log	1.4902	76	1.3807	0.2349	1.3807	1.1751
No log	1.5294	78	1.1355	0.2067	1.1355	1.0656
No log	1.5686	80	0.9426	0.3590	0.9426	0.9709
No log	1.6078	82	0.9155	0.3487	0.9155	0.9568
No log	1.6471	84	1.0109	0.3188	1.0109	1.0054
No log	1.6863	86	1.1378	0.2895	1.1378	1.0667
No log	1.7255	88	1.3715	0.3685	1.3715	1.1711
No log	1.7647	90	1.8387	0.2228	1.8387	1.3560
No log	1.8039	92	1.8412	0.2338	1.8412	1.3569
No log	1.8431	94	1.5266	0.2723	1.5266	1.2356
No log	1.8824	96	1.3521	0.1404	1.3521	1.1628
No log	1.9216	98	1.2775	0.1735	1.2775	1.1303
No log	1.9608	100	1.3496	0.1882	1.3496	1.1617
No log	2.0	102	1.1872	0.1772	1.1872	1.0896
No log	2.0392	104	1.0911	0.2337	1.0911	1.0446
No log	2.0784	106	1.1453	0.2058	1.1453	1.0702
No log	2.1176	108	1.0738	0.2912	1.0738	1.0363
No log	2.1569	110	1.1157	0.2825	1.1157	1.0563
No log	2.1961	112	1.2173	0.2833	1.2173	1.1033
No log	2.2353	114	1.2489	0.2815	1.2489	1.1175
No log	2.2745	116	1.1386	0.3370	1.1386	1.0671
No log	2.3137	118	1.2273	0.3220	1.2273	1.1078
No log	2.3529	120	1.2306	0.2100	1.2306	1.1093
No log	2.3922	122	1.1490	0.2986	1.1490	1.0719
No log	2.4314	124	1.1337	0.2572	1.1337	1.0647
No log	2.4706	126	1.1373	0.2949	1.1373	1.0665
No log	2.5098	128	1.2333	0.2114	1.2333	1.1106
No log	2.5490	130	1.3087	0.3302	1.3087	1.1440
No log	2.5882	132	1.2740	0.2972	1.2740	1.1287
No log	2.6275	134	1.2633	0.2933	1.2633	1.1240
No log	2.6667	136	1.1856	0.3013	1.1856	1.0888
No log	2.7059	138	1.1597	0.3444	1.1597	1.0769
No log	2.7451	140	1.1503	0.3640	1.1503	1.0725
No log	2.7843	142	1.1100	0.3632	1.1100	1.0535
No log	2.8235	144	1.1666	0.3380	1.1666	1.0801
No log	2.8627	146	1.3407	0.3233	1.3407	1.1579
No log	2.9020	148	1.4778	0.3645	1.4778	1.2156
No log	2.9412	150	1.3674	0.3730	1.3674	1.1693
No log	2.9804	152	1.1714	0.2595	1.1714	1.0823
No log	3.0196	154	1.1438	0.2542	1.1438	1.0695
No log	3.0588	156	1.1088	0.2857	1.1088	1.0530
No log	3.0980	158	1.1117	0.3268	1.1117	1.0544
No log	3.1373	160	1.3173	0.2105	1.3173	1.1477
No log	3.1765	162	1.3098	0.2631	1.3098	1.1445
No log	3.2157	164	1.1573	0.3675	1.1573	1.0758
No log	3.2549	166	1.1043	0.2966	1.1043	1.0508
No log	3.2941	168	1.1079	0.2968	1.1079	1.0526
No log	3.3333	170	1.1274	0.2168	1.1274	1.0618
No log	3.3725	172	1.1880	0.2501	1.1880	1.0899
No log	3.4118	174	1.3542	0.3108	1.3542	1.1637
No log	3.4510	176	1.3391	0.3022	1.3391	1.1572
No log	3.4902	178	1.1747	0.4035	1.1747	1.0838
No log	3.5294	180	1.1388	0.4126	1.1388	1.0672
No log	3.5686	182	1.2869	0.4073	1.2869	1.1344
No log	3.6078	184	1.5733	0.2286	1.5733	1.2543
No log	3.6471	186	1.8606	0.2405	1.8606	1.3640
No log	3.6863	188	1.6304	0.2286	1.6304	1.2769
No log	3.7255	190	1.1875	0.3355	1.1875	1.0897
No log	3.7647	192	1.0261	0.3109	1.0261	1.0130
No log	3.8039	194	1.0492	0.3256	1.0492	1.0243
No log	3.8431	196	1.0549	0.3345	1.0549	1.0271
No log	3.8824	198	1.0888	0.2965	1.0888	1.0435
No log	3.9216	200	1.1054	0.2735	1.1054	1.0514
No log	3.9608	202	1.1956	0.2140	1.1956	1.0934
No log	4.0	204	1.2754	0.2962	1.2754	1.1293
No log	4.0392	206	1.2366	0.2832	1.2366	1.1120
No log	4.0784	208	1.0997	0.3412	1.0997	1.0487
No log	4.1176	210	1.0217	0.3066	1.0217	1.0108
No log	4.1569	212	1.0396	0.3372	1.0396	1.0196
No log	4.1961	214	1.0209	0.3069	1.0209	1.0104
No log	4.2353	216	1.0209	0.3210	1.0209	1.0104
No log	4.2745	218	1.0220	0.3164	1.0220	1.0110
No log	4.3137	220	1.0342	0.2772	1.0342	1.0170
No log	4.3529	222	1.0361	0.2621	1.0361	1.0179
No log	4.3922	224	1.0185	0.3164	1.0185	1.0092
No log	4.4314	226	1.1448	0.2881	1.1448	1.0700
No log	4.4706	228	1.3510	0.3451	1.3510	1.1623
No log	4.5098	230	1.3116	0.3595	1.3116	1.1452
No log	4.5490	232	1.2273	0.3004	1.2273	1.1079
No log	4.5882	234	1.0985	0.2964	1.0985	1.0481
No log	4.6275	236	1.0856	0.2505	1.0856	1.0419
No log	4.6667	238	1.1853	0.2484	1.1853	1.0887
No log	4.7059	240	1.4377	0.3112	1.4377	1.1991
No log	4.7451	242	1.4179	0.2664	1.4179	1.1908
No log	4.7843	244	1.4150	0.2366	1.4150	1.1896
No log	4.8235	246	1.3181	0.2424	1.3181	1.1481
No log	4.8627	248	1.1165	0.2561	1.1165	1.0567
No log	4.9020	250	1.0456	0.3132	1.0456	1.0225
No log	4.9412	252	1.0394	0.2473	1.0394	1.0195
No log	4.9804	254	1.0191	0.2380	1.0191	1.0095
No log	5.0196	256	1.0377	0.3427	1.0377	1.0187
No log	5.0588	258	1.1860	0.3458	1.1860	1.0891
No log	5.0980	260	1.3076	0.2461	1.3076	1.1435
No log	5.1373	262	1.2161	0.3710	1.2161	1.1028
No log	5.1765	264	1.0876	0.3297	1.0876	1.0429
No log	5.2157	266	1.0108	0.3403	1.0108	1.0054
No log	5.2549	268	1.0229	0.3152	1.0229	1.0114
No log	5.2941	270	1.0286	0.3601	1.0286	1.0142
No log	5.3333	272	1.1128	0.3654	1.1128	1.0549
No log	5.3725	274	1.2167	0.2757	1.2167	1.1031
No log	5.4118	276	1.2359	0.2757	1.2359	1.1117
No log	5.4510	278	1.1798	0.3642	1.1798	1.0862
No log	5.4902	280	1.0637	0.4020	1.0637	1.0314
No log	5.5294	282	1.0341	0.3040	1.0341	1.0169
No log	5.5686	284	1.0359	0.3231	1.0359	1.0178
No log	5.6078	286	1.0253	0.3663	1.0253	1.0126
No log	5.6471	288	1.0940	0.2963	1.0940	1.0460
No log	5.6863	290	1.1936	0.1862	1.1936	1.0925
No log	5.7255	292	1.2357	0.2718	1.2357	1.1116
No log	5.7647	294	1.1800	0.2627	1.1800	1.0863
No log	5.8039	296	1.1335	0.3439	1.1335	1.0647
No log	5.8431	298	1.0828	0.3329	1.0828	1.0406
No log	5.8824	300	1.0796	0.3415	1.0796	1.0390
No log	5.9216	302	1.0782	0.3953	1.0782	1.0384
No log	5.9608	304	1.0984	0.2643	1.0984	1.0481
No log	6.0	306	1.1953	0.2424	1.1953	1.0933
No log	6.0392	308	1.2672	0.2617	1.2672	1.1257
No log	6.0784	310	1.2044	0.2031	1.2044	1.0975
No log	6.1176	312	1.1109	0.2455	1.1109	1.0540
No log	6.1569	314	1.0881	0.3577	1.0881	1.0431
No log	6.1961	316	1.1171	0.3046	1.1171	1.0569
No log	6.2353	318	1.1081	0.2558	1.1081	1.0527
No log	6.2745	320	1.0577	0.2587	1.0577	1.0285
No log	6.3137	322	1.0426	0.2915	1.0426	1.0211
No log	6.3529	324	1.0827	0.2851	1.0827	1.0405
No log	6.3922	326	1.0916	0.2921	1.0916	1.0448
No log	6.4314	328	1.0586	0.3329	1.0586	1.0289
No log	6.4706	330	1.0683	0.3237	1.0683	1.0336
No log	6.5098	332	1.1691	0.3450	1.1691	1.0813
No log	6.5490	334	1.1670	0.3129	1.1670	1.0803
No log	6.5882	336	1.1130	0.3338	1.1130	1.0550
No log	6.6275	338	1.0438	0.3386	1.0438	1.0217
No log	6.6667	340	1.0163	0.3497	1.0163	1.0081
No log	6.7059	342	1.0348	0.3458	1.0348	1.0173
No log	6.7451	344	1.1371	0.3363	1.1371	1.0663
No log	6.7843	346	1.2299	0.2832	1.2299	1.1090
No log	6.8235	348	1.1573	0.2963	1.1573	1.0758
No log	6.8627	350	1.0637	0.2988	1.0637	1.0314
No log	6.9020	352	1.0439	0.3108	1.0439	1.0217
No log	6.9412	354	1.0808	0.3280	1.0808	1.0396
No log	6.9804	356	1.1586	0.3074	1.1586	1.0764
No log	7.0196	358	1.2868	0.3004	1.2868	1.1344
No log	7.0588	360	1.3159	0.3303	1.3159	1.1471
No log	7.0980	362	1.1965	0.3330	1.1965	1.0938
No log	7.1373	364	1.0590	0.3568	1.0590	1.0291
No log	7.1765	366	1.0323	0.3301	1.0323	1.0160
No log	7.2157	368	1.0278	0.3115	1.0278	1.0138
No log	7.2549	370	1.0547	0.3163	1.0547	1.0270
No log	7.2941	372	1.0742	0.3062	1.0742	1.0364
No log	7.3333	374	1.0528	0.2614	1.0528	1.0261
No log	7.3725	376	1.0515	0.3163	1.0515	1.0254
No log	7.4118	378	1.0528	0.3062	1.0528	1.0260
No log	7.4510	380	1.0927	0.3237	1.0927	1.0453
No log	7.4902	382	1.2201	0.3088	1.2201	1.1046
No log	7.5294	384	1.2290	0.3174	1.2290	1.1086
No log	7.5686	386	1.2316	0.3947	1.2316	1.1098
No log	7.6078	388	1.1202	0.3670	1.1202	1.0584
No log	7.6471	390	1.0238	0.4494	1.0238	1.0118
No log	7.6863	392	0.9582	0.3500	0.9582	0.9789
No log	7.7255	394	0.9637	0.3996	0.9637	0.9817
No log	7.7647	396	1.0192	0.3741	1.0192	1.0096
No log	7.8039	398	1.0402	0.3452	1.0402	1.0199
No log	7.8431	400	1.0367	0.3782	1.0367	1.0182
No log	7.8824	402	0.9766	0.3765	0.9766	0.9882
No log	7.9216	404	0.9655	0.4385	0.9655	0.9826
No log	7.9608	406	0.9941	0.4100	0.9941	0.9970
No log	8.0	408	1.1572	0.3535	1.1572	1.0758
No log	8.0392	410	1.3895	0.3117	1.3895	1.1788
No log	8.0784	412	1.4655	0.3361	1.4655	1.2106
No log	8.1176	414	1.2962	0.2875	1.2962	1.1385
No log	8.1569	416	1.1130	0.2750	1.1130	1.0550
No log	8.1961	418	1.0453	0.2469	1.0453	1.0224
No log	8.2353	420	1.0265	0.3497	1.0265	1.0131
No log	8.2745	422	1.0503	0.2126	1.0503	1.0248
No log	8.3137	424	1.1984	0.2825	1.1984	1.0947
No log	8.3529	426	1.2626	0.3174	1.2626	1.1237
No log	8.3922	428	1.2105	0.3484	1.2105	1.1002
No log	8.4314	430	1.1372	0.2806	1.1372	1.0664
No log	8.4706	432	1.0870	0.2679	1.0870	1.0426
No log	8.5098	434	1.0968	0.2528	1.0968	1.0473
No log	8.5490	436	1.1336	0.2528	1.1336	1.0647
No log	8.5882	438	1.1383	0.2100	1.1383	1.0669
No log	8.6275	440	1.1400	0.2562	1.1400	1.0677
No log	8.6667	442	1.0945	0.2612	1.0945	1.0462
No log	8.7059	444	1.0773	0.2380	1.0773	1.0379
No log	8.7451	446	1.0680	0.1992	1.0680	1.0335
No log	8.7843	448	1.0649	0.2100	1.0649	1.0320
No log	8.8235	450	1.0620	0.2892	1.0620	1.0305
No log	8.8627	452	1.0880	0.2669	1.0880	1.0431
No log	8.9020	454	1.1681	0.2780	1.1681	1.0808
No log	8.9412	456	1.2513	0.2589	1.2513	1.1186
No log	8.9804	458	1.2748	0.2503	1.2748	1.1291
No log	9.0196	460	1.1808	0.2780	1.1808	1.0866
No log	9.0588	462	1.1205	0.3100	1.1205	1.0585
No log	9.0980	464	1.0375	0.3780	1.0375	1.0186
No log	9.1373	466	1.0194	0.3155	1.0194	1.0096
No log	9.1765	468	1.0332	0.3584	1.0332	1.0164
No log	9.2157	470	1.1034	0.2560	1.1034	1.0504
No log	9.2549	472	1.1298	0.3074	1.1298	1.0629
No log	9.2941	474	1.0764	0.3213	1.0764	1.0375
No log	9.3333	476	1.0267	0.3218	1.0267	1.0133
No log	9.3725	478	0.9899	0.3554	0.9899	0.9949
No log	9.4118	480	0.9926	0.3648	0.9926	0.9963
No log	9.4510	482	1.0477	0.3694	1.0477	1.0236
No log	9.4902	484	1.1786	0.3547	1.1786	1.0857
No log	9.5294	486	1.2910	0.3865	1.2910	1.1362
No log	9.5686	488	1.2365	0.4154	1.2365	1.1120
No log	9.6078	490	1.1340	0.3841	1.1340	1.0649
No log	9.6471	492	1.0696	0.3663	1.0696	1.0342
No log	9.6863	494	1.0037	0.3433	1.0037	1.0018
No log	9.7255	496	0.9925	0.3541	0.9925	0.9962
No log	9.7647	498	0.9834	0.3756	0.9834	0.9917
0.3772	9.8039	500	0.9874	0.3537	0.9874	0.9937
0.3772	9.8431	502	1.0096	0.3728	1.0096	1.0048
0.3772	9.8824	504	1.0694	0.4210	1.0694	1.0341
0.3772	9.9216	506	1.1973	0.3232	1.1973	1.0942
0.3772	9.9608	508	1.3902	0.3022	1.3902	1.1791
0.3772	10.0	510	1.4071	0.2942	1.4071	1.1862
0.3772	10.0392	512	1.3233	0.2899	1.3233	1.1503
0.3772	10.0784	514	1.1279	0.3010	1.1279	1.0620

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1