ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k1_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3695
• Qwk: 0.4544
• Mse: 1.3695
• Rmse: 1.1703

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.25	2	6.1624	-0.0706	6.1624	2.4824
No log	0.5	4	3.5613	0.0	3.5613	1.8871
No log	0.75	6	2.5455	0.1579	2.5455	1.5955
No log	1.0	8	1.6278	0.0040	1.6278	1.2758
No log	1.25	10	1.2824	0.1955	1.2824	1.1324
No log	1.5	12	1.6055	-0.0088	1.6055	1.2671
No log	1.75	14	1.5441	-0.0047	1.5441	1.2426
No log	2.0	16	1.2823	0.1096	1.2823	1.1324
No log	2.25	18	1.2409	0.0368	1.2409	1.1139
No log	2.5	20	1.2553	0.0549	1.2553	1.1204
No log	2.75	22	1.1943	0.1675	1.1943	1.0929
No log	3.0	24	1.1168	0.2522	1.1168	1.0568
No log	3.25	26	1.0638	0.3719	1.0638	1.0314
No log	3.5	28	1.0251	0.4084	1.0251	1.0125
No log	3.75	30	1.0009	0.3639	1.0009	1.0005
No log	4.0	32	1.0700	0.2938	1.0700	1.0344
No log	4.25	34	1.1159	0.3405	1.1159	1.0564
No log	4.5	36	1.0702	0.4660	1.0702	1.0345
No log	4.75	38	1.0538	0.4541	1.0538	1.0266
No log	5.0	40	1.0069	0.4658	1.0069	1.0034
No log	5.25	42	1.0888	0.4967	1.0888	1.0435
No log	5.5	44	1.2981	0.4495	1.2981	1.1394
No log	5.75	46	1.4702	0.3598	1.4702	1.2125
No log	6.0	48	1.4864	0.3460	1.4864	1.2192
No log	6.25	50	1.2896	0.3978	1.2896	1.1356
No log	6.5	52	1.0840	0.4961	1.0840	1.0412
No log	6.75	54	0.8934	0.5202	0.8934	0.9452
No log	7.0	56	0.9289	0.5342	0.9289	0.9638
No log	7.25	58	1.1245	0.5286	1.1245	1.0604
No log	7.5	60	1.4326	0.4212	1.4326	1.1969
No log	7.75	62	1.5608	0.3842	1.5608	1.2493
No log	8.0	64	1.4844	0.3791	1.4844	1.2183
No log	8.25	66	1.5824	0.3639	1.5824	1.2579
No log	8.5	68	1.3203	0.4887	1.3203	1.1491
No log	8.75	70	0.9985	0.5603	0.9985	0.9992
No log	9.0	72	0.9071	0.5763	0.9071	0.9524
No log	9.25	74	0.9098	0.5766	0.9098	0.9538
No log	9.5	76	1.0955	0.5369	1.0955	1.0467
No log	9.75	78	1.2848	0.4451	1.2848	1.1335
No log	10.0	80	1.5414	0.3784	1.5414	1.2416
No log	10.25	82	1.3994	0.4111	1.3994	1.1830
No log	10.5	84	1.1481	0.5556	1.1481	1.0715
No log	10.75	86	1.1314	0.6037	1.1314	1.0637
No log	11.0	88	1.1100	0.5809	1.1100	1.0535
No log	11.25	90	1.0561	0.6095	1.0561	1.0277
No log	11.5	92	1.1391	0.5804	1.1391	1.0673
No log	11.75	94	1.1138	0.5708	1.1138	1.0554
No log	12.0	96	1.1746	0.5466	1.1746	1.0838
No log	12.25	98	1.2412	0.5450	1.2412	1.1141
No log	12.5	100	1.1402	0.5712	1.1402	1.0678
No log	12.75	102	0.9024	0.6314	0.9024	0.9500
No log	13.0	104	0.8731	0.6048	0.8731	0.9344
No log	13.25	106	1.0013	0.5656	1.0013	1.0007
No log	13.5	108	1.4501	0.4577	1.4501	1.2042
No log	13.75	110	1.7658	0.4277	1.7658	1.3288
No log	14.0	112	1.4934	0.4526	1.4934	1.2220
No log	14.25	114	0.9414	0.5533	0.9414	0.9703
No log	14.5	116	0.8129	0.5855	0.8129	0.9016
No log	14.75	118	0.9306	0.6009	0.9306	0.9647
No log	15.0	120	1.0375	0.6060	1.0375	1.0186
No log	15.25	122	1.2989	0.5142	1.2989	1.1397
No log	15.5	124	1.5684	0.4463	1.5684	1.2524
No log	15.75	126	1.4233	0.4649	1.4233	1.1930
No log	16.0	128	1.2344	0.5090	1.2344	1.1110
No log	16.25	130	1.0699	0.5587	1.0699	1.0344
No log	16.5	132	1.0517	0.5707	1.0517	1.0255
No log	16.75	134	1.0340	0.5798	1.0340	1.0168
No log	17.0	136	1.0843	0.5552	1.0843	1.0413
No log	17.25	138	1.1526	0.5263	1.1526	1.0736
No log	17.5	140	1.2854	0.4908	1.2854	1.1338
No log	17.75	142	1.5153	0.4309	1.5153	1.2310
No log	18.0	144	1.5757	0.4173	1.5757	1.2553
No log	18.25	146	1.5584	0.4307	1.5584	1.2484
No log	18.5	148	1.3237	0.5056	1.3237	1.1505
No log	18.75	150	1.0690	0.5835	1.0690	1.0339
No log	19.0	152	1.1571	0.5508	1.1571	1.0757
No log	19.25	154	1.5644	0.4321	1.5643	1.2507
No log	19.5	156	2.0750	0.3742	2.0750	1.4405
No log	19.75	158	2.0623	0.3666	2.0623	1.4361
No log	20.0	160	1.6791	0.4305	1.6791	1.2958
No log	20.25	162	1.1497	0.5231	1.1497	1.0722
No log	20.5	164	0.9686	0.5350	0.9686	0.9842
No log	20.75	166	1.0121	0.5145	1.0121	1.0060
No log	21.0	168	1.1589	0.5119	1.1589	1.0765
No log	21.25	170	1.2528	0.4051	1.2528	1.1193
No log	21.5	172	1.4304	0.4078	1.4304	1.1960
No log	21.75	174	1.4455	0.4757	1.4455	1.2023
No log	22.0	176	1.2185	0.5385	1.2185	1.1038
No log	22.25	178	1.1302	0.6144	1.1302	1.0631
No log	22.5	180	1.1730	0.5423	1.1730	1.0830
No log	22.75	182	1.3355	0.4895	1.3355	1.1556
No log	23.0	184	1.5830	0.4548	1.5830	1.2582
No log	23.25	186	1.4469	0.4745	1.4469	1.2029
No log	23.5	188	1.3034	0.4974	1.3034	1.1417
No log	23.75	190	1.1066	0.5587	1.1066	1.0520
No log	24.0	192	0.9069	0.5705	0.9069	0.9523
No log	24.25	194	0.8942	0.6081	0.8942	0.9456
No log	24.5	196	1.0207	0.5903	1.0207	1.0103
No log	24.75	198	1.2995	0.5293	1.2995	1.1400
No log	25.0	200	1.5778	0.4296	1.5778	1.2561
No log	25.25	202	1.6005	0.4061	1.6005	1.2651
No log	25.5	204	1.4197	0.4299	1.4197	1.1915
No log	25.75	206	1.1132	0.5501	1.1132	1.0551
No log	26.0	208	0.9832	0.5783	0.9832	0.9915
No log	26.25	210	1.0190	0.5732	1.0190	1.0095
No log	26.5	212	1.1958	0.5551	1.1958	1.0935
No log	26.75	214	1.5382	0.4700	1.5382	1.2402
No log	27.0	216	1.7303	0.4242	1.7303	1.3154
No log	27.25	218	1.6461	0.4518	1.6461	1.2830
No log	27.5	220	1.3951	0.4903	1.3951	1.1812
No log	27.75	222	1.1813	0.5463	1.1813	1.0869
No log	28.0	224	1.2194	0.5497	1.2194	1.1043
No log	28.25	226	1.3331	0.5310	1.3331	1.1546
No log	28.5	228	1.3452	0.4930	1.3452	1.1598
No log	28.75	230	1.3509	0.5005	1.3509	1.1623
No log	29.0	232	1.2707	0.5248	1.2707	1.1273
No log	29.25	234	1.2423	0.5210	1.2423	1.1146
No log	29.5	236	1.2702	0.5164	1.2702	1.1270
No log	29.75	238	1.3378	0.4755	1.3378	1.1566
No log	30.0	240	1.5427	0.4276	1.5427	1.2421
No log	30.25	242	1.6053	0.3735	1.6053	1.2670
No log	30.5	244	1.4230	0.3883	1.4230	1.1929
No log	30.75	246	1.2052	0.4515	1.2052	1.0978
No log	31.0	248	0.9858	0.5401	0.9858	0.9929
No log	31.25	250	0.9062	0.5524	0.9062	0.9520
No log	31.5	252	0.9635	0.5512	0.9635	0.9816
No log	31.75	254	1.1533	0.4873	1.1533	1.0739
No log	32.0	256	1.3569	0.4741	1.3569	1.1649
No log	32.25	258	1.5307	0.4200	1.5307	1.2372
No log	32.5	260	1.5473	0.3883	1.5473	1.2439
No log	32.75	262	1.3939	0.4207	1.3939	1.1806
No log	33.0	264	1.2228	0.5030	1.2228	1.1058
No log	33.25	266	1.0518	0.5458	1.0518	1.0256
No log	33.5	268	1.0275	0.5517	1.0275	1.0137
No log	33.75	270	1.0989	0.5368	1.0989	1.0483
No log	34.0	272	1.2687	0.4866	1.2687	1.1264
No log	34.25	274	1.3851	0.4364	1.3851	1.1769
No log	34.5	276	1.3607	0.4364	1.3607	1.1665
No log	34.75	278	1.1604	0.5124	1.1604	1.0772
No log	35.0	280	1.0030	0.5437	1.0030	1.0015
No log	35.25	282	0.9142	0.5539	0.9142	0.9562
No log	35.5	284	0.9135	0.5399	0.9135	0.9558
No log	35.75	286	1.0236	0.5362	1.0236	1.0118
No log	36.0	288	1.3074	0.4991	1.3074	1.1434
No log	36.25	290	1.4686	0.4415	1.4686	1.2119
No log	36.5	292	1.3958	0.4653	1.3958	1.1814
No log	36.75	294	1.1703	0.5517	1.1703	1.0818
No log	37.0	296	1.0699	0.5554	1.0699	1.0344
No log	37.25	298	1.1294	0.5248	1.1294	1.0627
No log	37.5	300	1.2024	0.5132	1.2024	1.0965
No log	37.75	302	1.3933	0.4449	1.3933	1.1804
No log	38.0	304	1.4384	0.4599	1.4384	1.1993
No log	38.25	306	1.3083	0.4927	1.3083	1.1438
No log	38.5	308	1.1030	0.5169	1.1030	1.0503
No log	38.75	310	1.0390	0.5656	1.0390	1.0193
No log	39.0	312	1.0553	0.5644	1.0553	1.0273
No log	39.25	314	1.1023	0.5577	1.1023	1.0499
No log	39.5	316	1.1766	0.5260	1.1766	1.0847
No log	39.75	318	1.3017	0.4815	1.3017	1.1409
No log	40.0	320	1.4011	0.4637	1.4011	1.1837
No log	40.25	322	1.3344	0.4681	1.3344	1.1552
No log	40.5	324	1.1576	0.5201	1.1576	1.0759
No log	40.75	326	1.0097	0.5268	1.0097	1.0049
No log	41.0	328	0.9340	0.5361	0.9340	0.9664
No log	41.25	330	0.9453	0.5213	0.9453	0.9723
No log	41.5	332	1.0604	0.4914	1.0604	1.0298
No log	41.75	334	1.1438	0.5280	1.1438	1.0695
No log	42.0	336	1.0982	0.5550	1.0982	1.0480
No log	42.25	338	1.0345	0.5400	1.0345	1.0171
No log	42.5	340	1.0091	0.5512	1.0091	1.0046
No log	42.75	342	1.0452	0.5418	1.0452	1.0223
No log	43.0	344	1.1072	0.5522	1.1072	1.0522
No log	43.25	346	1.2380	0.5099	1.2380	1.1126
No log	43.5	348	1.3083	0.5112	1.3083	1.1438
No log	43.75	350	1.2078	0.5273	1.2078	1.0990
No log	44.0	352	1.0679	0.5533	1.0679	1.0334
No log	44.25	354	0.9973	0.5934	0.9973	0.9987
No log	44.5	356	0.9995	0.5806	0.9995	0.9997
No log	44.75	358	1.0757	0.5850	1.0757	1.0372
No log	45.0	360	1.1068	0.5850	1.1068	1.0520
No log	45.25	362	1.1282	0.5554	1.1282	1.0622
No log	45.5	364	1.2217	0.5136	1.2217	1.1053
No log	45.75	366	1.2929	0.5032	1.2929	1.1371
No log	46.0	368	1.3294	0.4710	1.3294	1.1530
No log	46.25	370	1.2694	0.4783	1.2694	1.1267
No log	46.5	372	1.1584	0.5040	1.1584	1.0763
No log	46.75	374	1.0474	0.5211	1.0474	1.0234
No log	47.0	376	0.9284	0.5206	0.9284	0.9635
No log	47.25	378	0.9004	0.5413	0.9004	0.9489
No log	47.5	380	0.9670	0.5784	0.9670	0.9834
No log	47.75	382	1.0651	0.5686	1.0651	1.0320
No log	48.0	384	1.2644	0.5094	1.2644	1.1245
No log	48.25	386	1.4922	0.4452	1.4922	1.2216
No log	48.5	388	1.5521	0.4143	1.5521	1.2458
No log	48.75	390	1.4158	0.4707	1.4158	1.1899
No log	49.0	392	1.2168	0.5066	1.2168	1.1031
No log	49.25	394	1.0685	0.5557	1.0685	1.0337
No log	49.5	396	1.0141	0.5523	1.0141	1.0070
No log	49.75	398	0.9574	0.5475	0.9574	0.9785
No log	50.0	400	0.9694	0.5475	0.9694	0.9846
No log	50.25	402	1.0639	0.5448	1.0639	1.0315
No log	50.5	404	1.2637	0.5188	1.2637	1.1241
No log	50.75	406	1.3999	0.4388	1.3999	1.1832
No log	51.0	408	1.3862	0.4637	1.3862	1.1774
No log	51.25	410	1.2419	0.5229	1.2419	1.1144
No log	51.5	412	1.1322	0.5427	1.1322	1.0640
No log	51.75	414	1.0653	0.5399	1.0653	1.0321
No log	52.0	416	1.1108	0.5309	1.1108	1.0540
No log	52.25	418	1.1827	0.53	1.1827	1.0875
No log	52.5	420	1.2126	0.53	1.2126	1.1012
No log	52.75	422	1.2066	0.5254	1.2066	1.0984
No log	53.0	424	1.2440	0.4969	1.2440	1.1153
No log	53.25	426	1.2644	0.4920	1.2644	1.1245
No log	53.5	428	1.1900	0.5068	1.1900	1.0909
No log	53.75	430	1.1441	0.5047	1.1441	1.0696
No log	54.0	432	1.1588	0.5010	1.1588	1.0765
No log	54.25	434	1.1384	0.5253	1.1384	1.0669
No log	54.5	436	1.1693	0.5091	1.1693	1.0813
No log	54.75	438	1.1924	0.5025	1.1924	1.0920
No log	55.0	440	1.2294	0.4883	1.2294	1.1088
No log	55.25	442	1.2826	0.4949	1.2826	1.1325
No log	55.5	444	1.2400	0.4997	1.2400	1.1135
No log	55.75	446	1.1951	0.5094	1.1951	1.0932
No log	56.0	448	1.1788	0.5051	1.1788	1.0857
No log	56.25	450	1.1544	0.5221	1.1544	1.0744
No log	56.5	452	1.1169	0.5422	1.1169	1.0568
No log	56.75	454	1.1381	0.5134	1.1381	1.0668
No log	57.0	456	1.1553	0.5213	1.1553	1.0749
No log	57.25	458	1.2593	0.4932	1.2593	1.1222
No log	57.5	460	1.3129	0.4949	1.3129	1.1458
No log	57.75	462	1.3002	0.4792	1.3002	1.1403
No log	58.0	464	1.2844	0.4831	1.2844	1.1333
No log	58.25	466	1.1847	0.4917	1.1847	1.0885
No log	58.5	468	1.1206	0.5181	1.1206	1.0586
No log	58.75	470	1.1254	0.5377	1.1254	1.0608
No log	59.0	472	1.1733	0.4889	1.1733	1.0832
No log	59.25	474	1.2079	0.4917	1.2079	1.0990
No log	59.5	476	1.1885	0.5233	1.1885	1.0902
No log	59.75	478	1.2008	0.5185	1.2008	1.0958
No log	60.0	480	1.2468	0.4875	1.2468	1.1166
No log	60.25	482	1.3223	0.4945	1.3223	1.1499
No log	60.5	484	1.4170	0.4402	1.4170	1.1904
No log	60.75	486	1.4028	0.4397	1.4028	1.1844
No log	61.0	488	1.3276	0.4857	1.3276	1.1522
No log	61.25	490	1.2561	0.4931	1.2561	1.1207
No log	61.5	492	1.1262	0.5420	1.1262	1.0612
No log	61.75	494	1.0642	0.5502	1.0642	1.0316
No log	62.0	496	1.0780	0.5491	1.0780	1.0383
No log	62.25	498	1.1434	0.5410	1.1434	1.0693
0.3165	62.5	500	1.2870	0.5005	1.2870	1.1344
0.3165	62.75	502	1.4619	0.4514	1.4619	1.2091
0.3165	63.0	504	1.4915	0.4550	1.4915	1.2213
0.3165	63.25	506	1.4018	0.4871	1.4018	1.1840
0.3165	63.5	508	1.2301	0.5350	1.2301	1.1091
0.3165	63.75	510	1.0572	0.5686	1.0572	1.0282
0.3165	64.0	512	0.9375	0.5845	0.9375	0.9682
0.3165	64.25	514	0.9153	0.5887	0.9153	0.9567
0.3165	64.5	516	0.9724	0.5771	0.9724	0.9861
0.3165	64.75	518	1.0697	0.5745	1.0697	1.0342
0.3165	65.0	520	1.1218	0.5617	1.1218	1.0591
0.3165	65.25	522	1.1978	0.5314	1.1978	1.0944
0.3165	65.5	524	1.1962	0.5305	1.1962	1.0937
0.3165	65.75	526	1.1446	0.5302	1.1446	1.0699
0.3165	66.0	528	1.1750	0.5293	1.1750	1.0840
0.3165	66.25	530	1.2172	0.5236	1.2172	1.1033
0.3165	66.5	532	1.2005	0.5089	1.2005	1.0957
0.3165	66.75	534	1.1895	0.5103	1.1895	1.0907
0.3165	67.0	536	1.1855	0.4831	1.1855	1.0888
0.3165	67.25	538	1.1962	0.5016	1.1962	1.0937
0.3165	67.5	540	1.1935	0.5009	1.1935	1.0925
0.3165	67.75	542	1.1532	0.5142	1.1532	1.0739
0.3165	68.0	544	1.1209	0.5338	1.1209	1.0587
0.3165	68.25	546	1.1038	0.5244	1.1038	1.0506
0.3165	68.5	548	1.1193	0.5244	1.1193	1.0580
0.3165	68.75	550	1.1323	0.5235	1.1323	1.0641
0.3165	69.0	552	1.1596	0.5173	1.1596	1.0769
0.3165	69.25	554	1.2426	0.5084	1.2426	1.1147
0.3165	69.5	556	1.2674	0.5084	1.2674	1.1258
0.3165	69.75	558	1.2222	0.5241	1.2222	1.1055
0.3165	70.0	560	1.1719	0.5304	1.1719	1.0825
0.3165	70.25	562	1.1141	0.5389	1.1141	1.0555
0.3165	70.5	564	1.0842	0.5184	1.0842	1.0413
0.3165	70.75	566	1.0684	0.5100	1.0684	1.0337
0.3165	71.0	568	1.0717	0.5184	1.0717	1.0352
0.3165	71.25	570	1.0909	0.5232	1.0909	1.0445
0.3165	71.5	572	1.1214	0.5257	1.1214	1.0590
0.3165	71.75	574	1.1722	0.5248	1.1722	1.0827
0.3165	72.0	576	1.2195	0.5126	1.2195	1.1043
0.3165	72.25	578	1.2119	0.5126	1.2119	1.1009
0.3165	72.5	580	1.2255	0.4897	1.2255	1.1070
0.3165	72.75	582	1.2225	0.4897	1.2225	1.1057
0.3165	73.0	584	1.1658	0.5403	1.1658	1.0797
0.3165	73.25	586	1.1347	0.5425	1.1347	1.0652
0.3165	73.5	588	1.1401	0.5415	1.1401	1.0677
0.3165	73.75	590	1.1936	0.5214	1.1936	1.0925
0.3165	74.0	592	1.2676	0.4957	1.2676	1.1259
0.3165	74.25	594	1.3373	0.4781	1.3373	1.1564
0.3165	74.5	596	1.4038	0.4579	1.4039	1.1848
0.3165	74.75	598	1.3973	0.4579	1.3973	1.1821
0.3165	75.0	600	1.3695	0.4544	1.3695	1.1703

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1