ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k17_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7173
• Qwk: 0.6219
• Mse: 0.7173
• Rmse: 0.8469

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0241	2	5.3527	0.0007	5.3527	2.3136
No log	0.0482	4	3.3129	0.0601	3.3129	1.8201
No log	0.0723	6	2.7146	-0.1413	2.7146	1.6476
No log	0.0964	8	2.9227	-0.1085	2.9227	1.7096
No log	0.1205	10	2.2691	-0.1559	2.2691	1.5063
No log	0.1446	12	1.4761	0.0339	1.4761	1.2149
No log	0.1687	14	1.2283	0.2232	1.2283	1.1083
No log	0.1928	16	1.2914	0.1639	1.2914	1.1364
No log	0.2169	18	1.3943	0.0945	1.3943	1.1808
No log	0.2410	20	1.3929	0.0358	1.3929	1.1802
No log	0.2651	22	1.3284	0.0465	1.3284	1.1526
No log	0.2892	24	1.2032	0.1234	1.2032	1.0969
No log	0.3133	26	1.1020	0.2471	1.1020	1.0498
No log	0.3373	28	1.0975	0.3775	1.0975	1.0476
No log	0.3614	30	1.1348	0.3274	1.1348	1.0653
No log	0.3855	32	1.0507	0.3723	1.0507	1.0250
No log	0.4096	34	1.0313	0.3560	1.0313	1.0155
No log	0.4337	36	1.1273	0.3196	1.1273	1.0617
No log	0.4578	38	1.2556	0.2438	1.2556	1.1205
No log	0.4819	40	1.3041	0.2076	1.3041	1.1420
No log	0.5060	42	1.3097	0.1763	1.3097	1.1444
No log	0.5301	44	1.3073	0.1820	1.3073	1.1434
No log	0.5542	46	1.2338	0.3008	1.2338	1.1108
No log	0.5783	48	1.2130	0.2744	1.2130	1.1013
No log	0.6024	50	1.2321	0.2327	1.2321	1.1100
No log	0.6265	52	1.1916	0.1276	1.1916	1.0916
No log	0.6506	54	1.2868	0.0884	1.2868	1.1344
No log	0.6747	56	1.4274	-0.0333	1.4274	1.1947
No log	0.6988	58	1.4057	0.0498	1.4057	1.1856
No log	0.7229	60	1.4330	0.0561	1.4330	1.1971
No log	0.7470	62	1.3512	0.1448	1.3512	1.1624
No log	0.7711	64	1.2303	0.2055	1.2303	1.1092
No log	0.7952	66	1.1896	0.1891	1.1896	1.0907
No log	0.8193	68	1.1106	0.2455	1.1106	1.0538
No log	0.8434	70	1.0369	0.2825	1.0369	1.0183
No log	0.8675	72	0.9967	0.2763	0.9967	0.9984
No log	0.8916	74	0.9908	0.2960	0.9908	0.9954
No log	0.9157	76	0.9911	0.2960	0.9911	0.9955
No log	0.9398	78	0.9941	0.2849	0.9941	0.9970
No log	0.9639	80	1.0098	0.3138	1.0098	1.0049
No log	0.9880	82	1.0606	0.2765	1.0606	1.0299
No log	1.0120	84	1.0944	0.2453	1.0944	1.0461
No log	1.0361	86	1.1465	0.2978	1.1465	1.0707
No log	1.0602	88	1.1082	0.2308	1.1082	1.0527
No log	1.0843	90	1.0679	0.2317	1.0679	1.0334
No log	1.1084	92	1.1634	0.2792	1.1634	1.0786
No log	1.1325	94	1.2506	0.3006	1.2506	1.1183
No log	1.1566	96	1.1501	0.3231	1.1501	1.0724
No log	1.1807	98	1.0311	0.2650	1.0311	1.0154
No log	1.2048	100	1.0817	0.2275	1.0817	1.0400
No log	1.2289	102	1.2102	0.2488	1.2102	1.1001
No log	1.2530	104	1.2113	0.2422	1.2113	1.1006
No log	1.2771	106	1.1130	0.2510	1.1130	1.0550
No log	1.3012	108	1.0394	0.3408	1.0394	1.0195
No log	1.3253	110	0.9827	0.3901	0.9827	0.9913
No log	1.3494	112	1.0023	0.4131	1.0023	1.0012
No log	1.3735	114	1.1134	0.3978	1.1134	1.0552
No log	1.3976	116	1.3007	0.3017	1.3007	1.1405
No log	1.4217	118	1.3612	0.2620	1.3612	1.1667
No log	1.4458	120	1.1967	0.2651	1.1967	1.0940
No log	1.4699	122	1.0082	0.4178	1.0082	1.0041
No log	1.4940	124	0.8925	0.4607	0.8925	0.9447
No log	1.5181	126	0.9248	0.4157	0.9248	0.9617
No log	1.5422	128	1.0850	0.4239	1.0850	1.0416
No log	1.5663	130	1.1496	0.3844	1.1496	1.0722
No log	1.5904	132	1.1119	0.3845	1.1119	1.0544
No log	1.6145	134	1.0203	0.4623	1.0203	1.0101
No log	1.6386	136	0.8625	0.4679	0.8625	0.9287
No log	1.6627	138	0.8600	0.4672	0.8600	0.9273
No log	1.6867	140	0.8336	0.4762	0.8336	0.9130
No log	1.7108	142	0.8654	0.5411	0.8654	0.9303
No log	1.7349	144	1.1207	0.4343	1.1207	1.0586
No log	1.7590	146	1.1351	0.4438	1.1351	1.0654
No log	1.7831	148	1.0756	0.4724	1.0756	1.0371
No log	1.8072	150	0.9260	0.5280	0.9260	0.9623
No log	1.8313	152	0.8549	0.4612	0.8549	0.9246
No log	1.8554	154	0.7912	0.4638	0.7912	0.8895
No log	1.8795	156	0.7785	0.5149	0.7785	0.8823
No log	1.9036	158	0.7730	0.5809	0.7730	0.8792
No log	1.9277	160	0.8724	0.5818	0.8724	0.9340
No log	1.9518	162	0.9064	0.5661	0.9064	0.9520
No log	1.9759	164	0.8174	0.6050	0.8174	0.9041
No log	2.0	166	0.7001	0.6552	0.7001	0.8367
No log	2.0241	168	0.7131	0.6743	0.7131	0.8444
No log	2.0482	170	0.7113	0.6637	0.7113	0.8434
No log	2.0723	172	0.7135	0.6634	0.7135	0.8447
No log	2.0964	174	0.8782	0.6081	0.8782	0.9371
No log	2.1205	176	0.9009	0.5796	0.9009	0.9491
No log	2.1446	178	0.7168	0.6422	0.7168	0.8466
No log	2.1687	180	0.6574	0.6450	0.6574	0.8108
No log	2.1928	182	0.6879	0.6192	0.6879	0.8294
No log	2.2169	184	0.6496	0.6355	0.6496	0.8060
No log	2.2410	186	0.6400	0.6531	0.6400	0.8000
No log	2.2651	188	0.6365	0.6581	0.6365	0.7978
No log	2.2892	190	0.6503	0.6144	0.6503	0.8064
No log	2.3133	192	0.7529	0.5984	0.7529	0.8677
No log	2.3373	194	0.8011	0.5856	0.8011	0.8951
No log	2.3614	196	0.7172	0.6069	0.7172	0.8469
No log	2.3855	198	0.6600	0.6486	0.6600	0.8124
No log	2.4096	200	0.6850	0.6335	0.6850	0.8276
No log	2.4337	202	0.7185	0.6280	0.7185	0.8476
No log	2.4578	204	0.8670	0.5649	0.8670	0.9311
No log	2.4819	206	1.1332	0.5177	1.1332	1.0645
No log	2.5060	208	1.1764	0.5081	1.1764	1.0846
No log	2.5301	210	1.0810	0.5221	1.0810	1.0397
No log	2.5542	212	0.8724	0.5649	0.8724	0.9340
No log	2.5783	214	0.7741	0.6125	0.7741	0.8798
No log	2.6024	216	0.7889	0.5956	0.7889	0.8882
No log	2.6265	218	0.8593	0.5577	0.8593	0.9270
No log	2.6506	220	0.9843	0.5717	0.9843	0.9921
No log	2.6747	222	1.1314	0.5174	1.1314	1.0637
No log	2.6988	224	1.0801	0.5330	1.0801	1.0393
No log	2.7229	226	0.8785	0.6116	0.8785	0.9373
No log	2.7470	228	0.7872	0.5847	0.7872	0.8873
No log	2.7711	230	0.7398	0.6238	0.7398	0.8601
No log	2.7952	232	0.7459	0.6071	0.7459	0.8637
No log	2.8193	234	0.7868	0.5644	0.7868	0.8870
No log	2.8434	236	0.9042	0.3779	0.9042	0.9509
No log	2.8675	238	0.9521	0.3944	0.9521	0.9758
No log	2.8916	240	0.9282	0.4840	0.9282	0.9634
No log	2.9157	242	0.8056	0.5545	0.8056	0.8976
No log	2.9398	244	0.7674	0.5923	0.7674	0.8760
No log	2.9639	246	0.7425	0.6062	0.7425	0.8617
No log	2.9880	248	0.7273	0.6423	0.7273	0.8528
No log	3.0120	250	0.7709	0.6238	0.7709	0.8780
No log	3.0361	252	0.8760	0.5553	0.8760	0.9359
No log	3.0602	254	0.9592	0.5388	0.9592	0.9794
No log	3.0843	256	0.9197	0.5477	0.9197	0.9590
No log	3.1084	258	0.8436	0.3961	0.8436	0.9185
No log	3.1325	260	0.8197	0.4262	0.8197	0.9054
No log	3.1566	262	0.7907	0.4438	0.7907	0.8892
No log	3.1807	264	0.8181	0.5548	0.8181	0.9045
No log	3.2048	266	0.9680	0.5232	0.9680	0.9839
No log	3.2289	268	1.0011	0.5213	1.0011	1.0005
No log	3.2530	270	0.9530	0.5441	0.9530	0.9762
No log	3.2771	272	0.8778	0.5539	0.8778	0.9369
No log	3.3012	274	0.8553	0.5539	0.8553	0.9248
No log	3.3253	276	0.8181	0.5954	0.8181	0.9045
No log	3.3494	278	0.8360	0.6251	0.8360	0.9143
No log	3.3735	280	0.9916	0.5333	0.9916	0.9958
No log	3.3976	282	1.0771	0.4838	1.0771	1.0378
No log	3.4217	284	1.1098	0.4741	1.1098	1.0535
No log	3.4458	286	1.1020	0.4788	1.1020	1.0498
No log	3.4699	288	1.2844	0.4165	1.2844	1.1333
No log	3.4940	290	1.3051	0.4064	1.3051	1.1424
No log	3.5181	292	1.1703	0.4620	1.1703	1.0818
No log	3.5422	294	0.9323	0.5496	0.9323	0.9655
No log	3.5663	296	0.8657	0.5884	0.8657	0.9304
No log	3.5904	298	0.9198	0.5496	0.9198	0.9591
No log	3.6145	300	1.1395	0.4871	1.1395	1.0675
No log	3.6386	302	1.4334	0.3888	1.4334	1.1972
No log	3.6627	304	1.4272	0.4145	1.4272	1.1947
No log	3.6867	306	1.1296	0.4869	1.1296	1.0628
No log	3.7108	308	0.7712	0.6319	0.7712	0.8782
No log	3.7349	310	0.6877	0.6661	0.6877	0.8293
No log	3.7590	312	0.6806	0.6569	0.6806	0.8250
No log	3.7831	314	0.7166	0.6603	0.7166	0.8466
No log	3.8072	316	0.8640	0.5531	0.8640	0.9295
No log	3.8313	318	0.9200	0.5244	0.9200	0.9592
No log	3.8554	320	0.8154	0.5912	0.8154	0.9030
No log	3.8795	322	0.7128	0.6239	0.7128	0.8443
No log	3.9036	324	0.7097	0.6233	0.7097	0.8424
No log	3.9277	326	0.7285	0.6487	0.7285	0.8535
No log	3.9518	328	0.7272	0.6521	0.7272	0.8528
No log	3.9759	330	0.7506	0.6762	0.7506	0.8664
No log	4.0	332	0.7932	0.6540	0.7932	0.8906
No log	4.0241	334	0.8032	0.6412	0.8032	0.8962
No log	4.0482	336	0.7525	0.6557	0.7525	0.8675
No log	4.0723	338	0.7203	0.6739	0.7203	0.8487
No log	4.0964	340	0.7247	0.6351	0.7247	0.8513
No log	4.1205	342	0.7055	0.6627	0.7055	0.8400
No log	4.1446	344	0.6917	0.6918	0.6917	0.8317
No log	4.1687	346	0.6830	0.6824	0.6830	0.8264
No log	4.1928	348	0.7106	0.6583	0.7106	0.8430
No log	4.2169	350	0.6995	0.6583	0.6995	0.8364
No log	4.2410	352	0.6697	0.6489	0.6697	0.8183
No log	4.2651	354	0.6750	0.6470	0.6750	0.8216
No log	4.2892	356	0.6498	0.6683	0.6498	0.8061
No log	4.3133	358	0.6526	0.6830	0.6526	0.8078
No log	4.3373	360	0.6521	0.6640	0.6521	0.8075
No log	4.3614	362	0.7624	0.6461	0.7624	0.8731
No log	4.3855	364	0.8801	0.6086	0.8801	0.9381
No log	4.4096	366	1.0938	0.5140	1.0938	1.0458
No log	4.4337	368	1.1773	0.4751	1.1773	1.0850
No log	4.4578	370	1.1507	0.4979	1.1507	1.0727
No log	4.4819	372	0.9949	0.5497	0.9949	0.9974
No log	4.5060	374	0.8360	0.5759	0.8360	0.9144
No log	4.5301	376	0.7662	0.6452	0.7662	0.8753
No log	4.5542	378	0.7216	0.6207	0.7216	0.8494
No log	4.5783	380	0.7158	0.6207	0.7158	0.8460
No log	4.6024	382	0.7546	0.6410	0.7546	0.8687
No log	4.6265	384	0.8610	0.5644	0.8610	0.9279
No log	4.6506	386	0.8845	0.5674	0.8845	0.9405
No log	4.6747	388	0.7930	0.5863	0.7930	0.8905
No log	4.6988	390	0.7326	0.5998	0.7326	0.8559
No log	4.7229	392	0.6817	0.6191	0.6817	0.8257
No log	4.7470	394	0.6686	0.6029	0.6686	0.8177
No log	4.7711	396	0.6786	0.5920	0.6786	0.8238
No log	4.7952	398	0.6512	0.6573	0.6512	0.8070
No log	4.8193	400	0.6927	0.6505	0.6927	0.8323
No log	4.8434	402	0.8794	0.5623	0.8794	0.9377
No log	4.8675	404	1.0104	0.5682	1.0104	1.0052
No log	4.8916	406	0.8777	0.5564	0.8777	0.9369
No log	4.9157	408	0.7828	0.5800	0.7828	0.8848
No log	4.9398	410	0.7050	0.6167	0.7050	0.8397
No log	4.9639	412	0.6791	0.6383	0.6791	0.8241
No log	4.9880	414	0.6827	0.6505	0.6827	0.8262
No log	5.0120	416	0.7039	0.6428	0.7039	0.8390
No log	5.0361	418	0.7292	0.6532	0.7292	0.8539
No log	5.0602	420	0.8739	0.5795	0.8739	0.9348
No log	5.0843	422	0.9209	0.5743	0.9209	0.9596
No log	5.1084	424	0.7959	0.6227	0.7959	0.8921
No log	5.1325	426	0.6775	0.6693	0.6775	0.8231
No log	5.1566	428	0.6708	0.6817	0.6708	0.8190
No log	5.1807	430	0.7023	0.6492	0.7023	0.8381
No log	5.2048	432	0.7233	0.6406	0.7233	0.8505
No log	5.2289	434	0.7105	0.6253	0.7105	0.8429
No log	5.2530	436	0.7181	0.5273	0.7181	0.8474
No log	5.2771	438	0.7394	0.4735	0.7394	0.8599
No log	5.3012	440	0.7610	0.5050	0.7610	0.8724
No log	5.3253	442	0.8818	0.5688	0.8818	0.9391
No log	5.3494	444	0.9504	0.5038	0.9504	0.9749
No log	5.3735	446	0.9316	0.5308	0.9316	0.9652
No log	5.3976	448	0.9174	0.5441	0.9174	0.9578
No log	5.4217	450	0.8274	0.5856	0.8274	0.9096
No log	5.4458	452	0.7590	0.6301	0.7590	0.8712
No log	5.4699	454	0.7752	0.6301	0.7752	0.8805
No log	5.4940	456	0.8309	0.5634	0.8309	0.9115
No log	5.5181	458	0.8247	0.6015	0.8247	0.9081
No log	5.5422	460	0.7683	0.5956	0.7683	0.8765
No log	5.5663	462	0.6982	0.6508	0.6982	0.8356
No log	5.5904	464	0.7087	0.6731	0.7087	0.8418
No log	5.6145	466	0.7142	0.6498	0.7142	0.8451
No log	5.6386	468	0.7307	0.5848	0.7307	0.8548
No log	5.6627	470	0.8001	0.6103	0.8001	0.8945
No log	5.6867	472	0.8848	0.5843	0.8848	0.9406
No log	5.7108	474	1.0777	0.5115	1.0777	1.0381
No log	5.7349	476	1.1672	0.4667	1.1672	1.0804
No log	5.7590	478	1.0505	0.5216	1.0505	1.0249
No log	5.7831	480	0.8650	0.5635	0.8650	0.9300
No log	5.8072	482	0.8330	0.5785	0.8330	0.9127
No log	5.8313	484	0.9206	0.5745	0.9206	0.9595
No log	5.8554	486	0.9541	0.5584	0.9541	0.9768
No log	5.8795	488	0.9939	0.5274	0.9939	0.9970
No log	5.9036	490	0.9635	0.5213	0.9635	0.9816
No log	5.9277	492	0.9412	0.5427	0.9412	0.9702
No log	5.9518	494	0.8770	0.6014	0.8770	0.9365
No log	5.9759	496	0.7859	0.6454	0.7859	0.8865
No log	6.0	498	0.7713	0.6490	0.7713	0.8782
0.4856	6.0241	500	0.8194	0.6319	0.8194	0.9052
0.4856	6.0482	502	0.8378	0.5965	0.8378	0.9153
0.4856	6.0723	504	0.8493	0.5924	0.8493	0.9216
0.4856	6.0964	506	0.8168	0.5843	0.8168	0.9038
0.4856	6.1205	508	0.7943	0.6226	0.7943	0.8912
0.4856	6.1446	510	0.7121	0.6583	0.7121	0.8439
0.4856	6.1687	512	0.7087	0.6763	0.7087	0.8418
0.4856	6.1928	514	0.8186	0.6414	0.8186	0.9048
0.4856	6.2169	516	0.8917	0.6066	0.8917	0.9443
0.4856	6.2410	518	0.8785	0.6156	0.8785	0.9373
0.4856	6.2651	520	0.8320	0.6427	0.8320	0.9121
0.4856	6.2892	522	0.8500	0.6027	0.8500	0.9219
0.4856	6.3133	524	0.8528	0.5972	0.8528	0.9235
0.4856	6.3373	526	0.7539	0.6290	0.7539	0.8683
0.4856	6.3614	528	0.6976	0.6367	0.6976	0.8353
0.4856	6.3855	530	0.6537	0.6579	0.6537	0.8085
0.4856	6.4096	532	0.6651	0.6653	0.6651	0.8155
0.4856	6.4337	534	0.6809	0.6704	0.6809	0.8252
0.4856	6.4578	536	0.8232	0.6619	0.8232	0.9073
0.4856	6.4819	538	1.0233	0.5778	1.0233	1.0116
0.4856	6.5060	540	1.1092	0.5270	1.1092	1.0532
0.4856	6.5301	542	1.0045	0.5356	1.0045	1.0023
0.4856	6.5542	544	0.8244	0.6187	0.8244	0.9080
0.4856	6.5783	546	0.7173	0.6219	0.7173	0.8469

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1