ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k10_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9903
• Qwk: 0.5525
• Mse: 0.9903
• Rmse: 0.9952

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0392	2	5.3450	-0.0339	5.3450	2.3119
No log	0.0784	4	3.1856	0.0686	3.1856	1.7848
No log	0.1176	6	2.6541	-0.1425	2.6541	1.6291
No log	0.1569	8	2.8760	-0.1542	2.8760	1.6959
No log	0.1961	10	2.1797	-0.1771	2.1797	1.4764
No log	0.2353	12	1.4761	-0.0203	1.4761	1.2149
No log	0.2745	14	1.4943	0.0187	1.4943	1.2224
No log	0.3137	16	1.5722	-0.0420	1.5722	1.2539
No log	0.3529	18	1.2870	0.1828	1.2870	1.1345
No log	0.3922	20	1.2289	0.1597	1.2289	1.1086
No log	0.4314	22	1.2057	0.1944	1.2057	1.0980
No log	0.4706	24	1.1903	0.2317	1.1903	1.0910
No log	0.5098	26	1.2386	0.2642	1.2386	1.1129
No log	0.5490	28	1.4388	-0.0385	1.4388	1.1995
No log	0.5882	30	1.4212	0.0234	1.4212	1.1922
No log	0.6275	32	1.3175	0.1791	1.3175	1.1478
No log	0.6667	34	1.2633	0.1771	1.2633	1.1240
No log	0.7059	36	1.3054	0.0185	1.3054	1.1426
No log	0.7451	38	1.2632	0.0417	1.2632	1.1239
No log	0.7843	40	1.2320	0.1721	1.2320	1.1100
No log	0.8235	42	1.1956	0.2251	1.1956	1.0934
No log	0.8627	44	1.1849	0.2611	1.1849	1.0885
No log	0.9020	46	1.2808	0.2087	1.2808	1.1317
No log	0.9412	48	1.2790	0.2725	1.2790	1.1309
No log	0.9804	50	1.1077	0.2753	1.1077	1.0525
No log	1.0196	52	1.0958	0.2555	1.0958	1.0468
No log	1.0588	54	1.1027	0.2386	1.1027	1.0501
No log	1.0980	56	1.1416	0.2302	1.1416	1.0685
No log	1.1373	58	1.0296	0.2587	1.0296	1.0147
No log	1.1765	60	0.9916	0.3646	0.9916	0.9958
No log	1.2157	62	0.9543	0.3513	0.9543	0.9769
No log	1.2549	64	1.0857	0.4045	1.0857	1.0420
No log	1.2941	66	0.9564	0.4202	0.9564	0.9780
No log	1.3333	68	0.9181	0.4616	0.9181	0.9582
No log	1.3725	70	1.0960	0.4595	1.0960	1.0469
No log	1.4118	72	1.0879	0.4883	1.0879	1.0430
No log	1.4510	74	0.9228	0.5068	0.9228	0.9607
No log	1.4902	76	0.8688	0.4218	0.8688	0.9321
No log	1.5294	78	0.8911	0.4217	0.8911	0.9440
No log	1.5686	80	1.0829	0.4594	1.0829	1.0406
No log	1.6078	82	1.1640	0.4554	1.1640	1.0789
No log	1.6471	84	1.0091	0.5090	1.0091	1.0045
No log	1.6863	86	0.8618	0.5657	0.8618	0.9283
No log	1.7255	88	0.9865	0.5402	0.9865	0.9932
No log	1.7647	90	1.3667	0.4267	1.3667	1.1690
No log	1.8039	92	1.2780	0.4294	1.2780	1.1305
No log	1.8431	94	1.1872	0.4898	1.1872	1.0896
No log	1.8824	96	1.0717	0.5028	1.0717	1.0352
No log	1.9216	98	1.0612	0.5120	1.0612	1.0302
No log	1.9608	100	1.2914	0.4613	1.2914	1.1364
No log	2.0	102	1.4624	0.4080	1.4624	1.2093
No log	2.0392	104	1.2683	0.4586	1.2683	1.1262
No log	2.0784	106	1.0204	0.5593	1.0204	1.0102
No log	2.1176	108	0.9580	0.5926	0.9580	0.9788
No log	2.1569	110	1.2618	0.4388	1.2618	1.1233
No log	2.1961	112	1.4096	0.4111	1.4096	1.1873
No log	2.2353	114	1.3078	0.4337	1.3078	1.1436
No log	2.2745	116	1.1917	0.4715	1.1917	1.0916
No log	2.3137	118	1.1472	0.4710	1.1472	1.0711
No log	2.3529	120	1.1442	0.4948	1.1442	1.0697
No log	2.3922	122	1.0679	0.5092	1.0679	1.0334
No log	2.4314	124	0.9696	0.5635	0.9696	0.9847
No log	2.4706	126	0.8417	0.6326	0.8417	0.9175
No log	2.5098	128	0.8678	0.6171	0.8678	0.9316
No log	2.5490	130	0.9609	0.5705	0.9609	0.9803
No log	2.5882	132	1.0085	0.5644	1.0085	1.0042
No log	2.6275	134	0.8555	0.6559	0.8555	0.9250
No log	2.6667	136	0.9333	0.6065	0.9333	0.9661
No log	2.7059	138	1.0565	0.5134	1.0565	1.0279
No log	2.7451	140	0.7754	0.6416	0.7754	0.8806
No log	2.7843	142	0.8227	0.5655	0.8227	0.9070
No log	2.8235	144	0.9507	0.5559	0.9507	0.9750
No log	2.8627	146	0.7417	0.5782	0.7417	0.8612
No log	2.9020	148	0.7943	0.5922	0.7943	0.8912
No log	2.9412	150	1.1226	0.4917	1.1226	1.0595
No log	2.9804	152	0.9930	0.5350	0.9930	0.9965
No log	3.0196	154	0.7476	0.5394	0.7476	0.8646
No log	3.0588	156	0.7341	0.5406	0.7341	0.8568
No log	3.0980	158	0.7185	0.6148	0.7185	0.8476
No log	3.1373	160	0.7592	0.6253	0.7592	0.8713
No log	3.1765	162	0.8172	0.6167	0.8172	0.9040
No log	3.2157	164	0.9894	0.5458	0.9894	0.9947
No log	3.2549	166	1.2111	0.5214	1.2111	1.1005
No log	3.2941	168	1.3035	0.4707	1.3035	1.1417
No log	3.3333	170	0.9766	0.5619	0.9766	0.9882
No log	3.3725	172	0.7671	0.6215	0.7671	0.8758
No log	3.4118	174	0.7660	0.5434	0.7660	0.8752
No log	3.4510	176	0.8401	0.6134	0.8401	0.9166
No log	3.4902	178	1.0186	0.5454	1.0186	1.0092
No log	3.5294	180	0.8797	0.6155	0.8797	0.9379
No log	3.5686	182	0.7378	0.6427	0.7378	0.8590
No log	3.6078	184	0.7279	0.6562	0.7279	0.8532
No log	3.6471	186	0.7725	0.6460	0.7725	0.8789
No log	3.6863	188	0.7566	0.6684	0.7566	0.8698
No log	3.7255	190	0.8097	0.6577	0.8097	0.8999
No log	3.7647	192	0.7665	0.6735	0.7665	0.8755
No log	3.8039	194	0.7543	0.6412	0.7543	0.8685
No log	3.8431	196	0.8050	0.6042	0.8050	0.8972
No log	3.8824	198	0.7687	0.5741	0.7687	0.8768
No log	3.9216	200	0.7221	0.5934	0.7221	0.8498
No log	3.9608	202	0.6935	0.6436	0.6935	0.8328
No log	4.0	204	0.7541	0.6563	0.7541	0.8684
No log	4.0392	206	0.9836	0.5471	0.9836	0.9917
No log	4.0784	208	1.1353	0.4936	1.1353	1.0655
No log	4.1176	210	0.9098	0.5867	0.9098	0.9538
No log	4.1569	212	0.9055	0.5921	0.9055	0.9516
No log	4.1961	214	0.9967	0.5514	0.9967	0.9984
No log	4.2353	216	0.9188	0.6262	0.9188	0.9586
No log	4.2745	218	0.9050	0.6262	0.9050	0.9513
No log	4.3137	220	1.0677	0.5099	1.0677	1.0333
No log	4.3529	222	1.2555	0.4550	1.2555	1.1205
No log	4.3922	224	0.9734	0.5910	0.9734	0.9866
No log	4.4314	226	0.8451	0.6135	0.8451	0.9193
No log	4.4706	228	0.8700	0.6070	0.8700	0.9327
No log	4.5098	230	1.0977	0.4938	1.0977	1.0477
No log	4.5490	232	1.1627	0.4904	1.1627	1.0783
No log	4.5882	234	1.0265	0.5301	1.0265	1.0131
No log	4.6275	236	0.9693	0.5364	0.9693	0.9845
No log	4.6667	238	1.2357	0.4579	1.2357	1.1116
No log	4.7059	240	1.2925	0.4433	1.2925	1.1369
No log	4.7451	242	1.1149	0.4929	1.1149	1.0559
No log	4.7843	244	0.9545	0.5903	0.9545	0.9770
No log	4.8235	246	0.7889	0.6654	0.7889	0.8882
No log	4.8627	248	0.8527	0.6215	0.8527	0.9234
No log	4.9020	250	1.0643	0.5293	1.0643	1.0316
No log	4.9412	252	1.0085	0.5623	1.0085	1.0042
No log	4.9804	254	0.8505	0.6238	0.8505	0.9222
No log	5.0196	256	0.7784	0.6623	0.7784	0.8823
No log	5.0588	258	0.7307	0.6491	0.7307	0.8548
No log	5.0980	260	0.7227	0.6651	0.7227	0.8501
No log	5.1373	262	0.7887	0.6468	0.7887	0.8881
No log	5.1765	264	0.8016	0.6532	0.8016	0.8953
No log	5.2157	266	0.7707	0.6560	0.7707	0.8779
No log	5.2549	268	0.7043	0.6449	0.7043	0.8392
No log	5.2941	270	0.6928	0.6134	0.6928	0.8323
No log	5.3333	272	0.7023	0.6411	0.7023	0.8380
No log	5.3725	274	0.7912	0.6533	0.7912	0.8895
No log	5.4118	276	0.8049	0.6505	0.8049	0.8972
No log	5.4510	278	0.7257	0.6837	0.7257	0.8519
No log	5.4902	280	0.7452	0.6569	0.7452	0.8632
No log	5.5294	282	0.7554	0.6742	0.7554	0.8691
No log	5.5686	284	0.7629	0.6475	0.7629	0.8734
No log	5.6078	286	0.6886	0.6996	0.6886	0.8298
No log	5.6471	288	0.7112	0.7100	0.7112	0.8433
No log	5.6863	290	0.7689	0.6787	0.7689	0.8769
No log	5.7255	292	0.8425	0.6194	0.8425	0.9179
No log	5.7647	294	1.0685	0.5456	1.0685	1.0337
No log	5.8039	296	1.0085	0.5657	1.0085	1.0042
No log	5.8431	298	0.7970	0.6481	0.7970	0.8927
No log	5.8824	300	0.8151	0.6481	0.8151	0.9029
No log	5.9216	302	0.8550	0.5979	0.8550	0.9247
No log	5.9608	304	1.0234	0.5352	1.0234	1.0116
No log	6.0	306	0.8764	0.5786	0.8764	0.9362
No log	6.0392	308	0.7198	0.6175	0.7198	0.8484
No log	6.0784	310	0.6892	0.6197	0.6892	0.8302
No log	6.1176	312	0.7106	0.6703	0.7106	0.8430
No log	6.1569	314	1.1422	0.5190	1.1422	1.0687
No log	6.1961	316	1.4263	0.4701	1.4263	1.1943
No log	6.2353	318	1.1583	0.5220	1.1583	1.0762
No log	6.2745	320	0.7611	0.6963	0.7611	0.8724
No log	6.3137	322	0.7173	0.6269	0.7173	0.8469
No log	6.3529	324	0.7243	0.6389	0.7243	0.8511
No log	6.3922	326	0.8499	0.6371	0.8499	0.9219
No log	6.4314	328	1.1879	0.4284	1.1879	1.0899
No log	6.4706	330	1.2466	0.4367	1.2466	1.1165
No log	6.5098	332	1.0367	0.5405	1.0367	1.0182
No log	6.5490	334	0.7788	0.6199	0.7788	0.8825
No log	6.5882	336	0.7260	0.5824	0.7260	0.8521
No log	6.6275	338	0.7337	0.5871	0.7337	0.8566
No log	6.6667	340	0.8404	0.6196	0.8404	0.9167
No log	6.7059	342	1.0654	0.5194	1.0654	1.0322
No log	6.7451	344	1.0899	0.5000	1.0899	1.0440
No log	6.7843	346	0.9468	0.5731	0.9468	0.9731
No log	6.8235	348	0.7628	0.6210	0.7628	0.8734
No log	6.8627	350	0.7389	0.6335	0.7389	0.8596
No log	6.9020	352	0.7408	0.5708	0.7408	0.8607
No log	6.9412	354	0.7673	0.5695	0.7673	0.8760
No log	6.9804	356	0.8332	0.5985	0.8332	0.9128
No log	7.0196	358	0.8545	0.5758	0.8545	0.9244
No log	7.0588	360	0.8124	0.5985	0.8124	0.9013
No log	7.0980	362	0.7675	0.5934	0.7675	0.8761
No log	7.1373	364	0.7750	0.5934	0.7750	0.8803
No log	7.1765	366	0.8007	0.6036	0.8007	0.8948
No log	7.2157	368	0.8231	0.5547	0.8231	0.9072
No log	7.2549	370	0.7826	0.5274	0.7826	0.8847
No log	7.2941	372	0.7836	0.4580	0.7836	0.8852
No log	7.3333	374	0.7739	0.5274	0.7739	0.8797
No log	7.3725	376	0.8761	0.5493	0.8761	0.9360
No log	7.4118	378	0.9999	0.5626	0.9999	0.9999
No log	7.4510	380	0.9041	0.6003	0.9041	0.9508
No log	7.4902	382	0.6887	0.6695	0.6887	0.8299
No log	7.5294	384	0.6551	0.6700	0.6551	0.8094
No log	7.5686	386	0.6707	0.6721	0.6707	0.8190
No log	7.6078	388	0.7213	0.6780	0.7213	0.8493
No log	7.6471	390	0.9541	0.6094	0.9541	0.9768
No log	7.6863	392	1.0528	0.5766	1.0528	1.0260
No log	7.7255	394	0.8772	0.6451	0.8772	0.9366
No log	7.7647	396	0.7044	0.6586	0.7044	0.8393
No log	7.8039	398	0.6805	0.6507	0.6805	0.8249
No log	7.8431	400	0.6854	0.6410	0.6854	0.8279
No log	7.8824	402	0.7608	0.6575	0.7608	0.8723
No log	7.9216	404	0.8646	0.6092	0.8646	0.9298
No log	7.9608	406	0.8174	0.6371	0.8174	0.9041
No log	8.0	408	0.7641	0.6463	0.7641	0.8741
No log	8.0392	410	0.7487	0.6734	0.7487	0.8653
No log	8.0784	412	0.7867	0.6431	0.7867	0.8870
No log	8.1176	414	0.8034	0.6373	0.8034	0.8963
No log	8.1569	416	0.7331	0.6364	0.7331	0.8562
No log	8.1961	418	0.7461	0.6657	0.7461	0.8638
No log	8.2353	420	0.7644	0.6331	0.7644	0.8743
No log	8.2745	422	0.7187	0.6721	0.7187	0.8478
No log	8.3137	424	0.7556	0.6336	0.7556	0.8693
No log	8.3529	426	0.8696	0.5826	0.8696	0.9325
No log	8.3922	428	0.8484	0.5827	0.8484	0.9211
No log	8.4314	430	0.8006	0.5801	0.8006	0.8948
No log	8.4706	432	0.8000	0.5945	0.8000	0.8944
No log	8.5098	434	0.7947	0.5945	0.7947	0.8914
No log	8.5490	436	0.7969	0.5787	0.7969	0.8927
No log	8.5882	438	0.8359	0.5987	0.8359	0.9143
No log	8.6275	440	0.7449	0.6124	0.7449	0.8631
No log	8.6667	442	0.7201	0.6469	0.7201	0.8486
No log	8.7059	444	0.8135	0.5947	0.8135	0.9019
No log	8.7451	446	0.8853	0.5775	0.8853	0.9409
No log	8.7843	448	0.9908	0.5592	0.9908	0.9954
No log	8.8235	450	0.9448	0.5605	0.9448	0.9720
No log	8.8627	452	0.8564	0.5731	0.8564	0.9254
No log	8.9020	454	0.9245	0.5688	0.9245	0.9615
No log	8.9412	456	1.0530	0.5343	1.0530	1.0262
No log	8.9804	458	1.1600	0.4852	1.1600	1.0770
No log	9.0196	460	1.0854	0.5077	1.0854	1.0418
No log	9.0588	462	0.9770	0.5494	0.9770	0.9884
No log	9.0980	464	1.0154	0.5371	1.0154	1.0077
No log	9.1373	466	1.0891	0.5102	1.0891	1.0436
No log	9.1765	468	1.1439	0.4796	1.1439	1.0695
No log	9.2157	470	1.1176	0.5184	1.1176	1.0572
No log	9.2549	472	0.9528	0.5786	0.9528	0.9761
No log	9.2941	474	0.8234	0.5818	0.8234	0.9074
No log	9.3333	476	0.7708	0.5576	0.7708	0.8780
No log	9.3725	478	0.7493	0.5144	0.7493	0.8656
No log	9.4118	480	0.8169	0.5611	0.8169	0.9038
No log	9.4510	482	0.8267	0.5984	0.8267	0.9092
No log	9.4902	484	0.7328	0.6024	0.7328	0.8561
No log	9.5294	486	0.6887	0.6097	0.6887	0.8299
No log	9.5686	488	0.6919	0.6097	0.6919	0.8318
No log	9.6078	490	0.6959	0.6050	0.6959	0.8342
No log	9.6471	492	0.7178	0.6082	0.7178	0.8472
No log	9.6863	494	0.7040	0.6054	0.7040	0.8391
No log	9.7255	496	0.7076	0.5720	0.7076	0.8412
No log	9.7647	498	0.7679	0.5985	0.7679	0.8763
0.4328	9.8039	500	0.9241	0.5718	0.9241	0.9613
0.4328	9.8431	502	0.9628	0.5637	0.9628	0.9812
0.4328	9.8824	504	0.8717	0.6217	0.8717	0.9337
0.4328	9.9216	506	0.7576	0.6146	0.7576	0.8704
0.4328	9.9608	508	0.7284	0.6394	0.7284	0.8535
0.4328	10.0	510	0.7871	0.6410	0.7871	0.8872
0.4328	10.0392	512	0.8746	0.6241	0.8746	0.9352
0.4328	10.0784	514	0.8178	0.6284	0.8178	0.9043
0.4328	10.1176	516	0.7718	0.6365	0.7718	0.8785
0.4328	10.1569	518	0.7403	0.6390	0.7403	0.8604
0.4328	10.1961	520	0.7442	0.6291	0.7442	0.8627
0.4328	10.2353	522	0.7424	0.6441	0.7424	0.8616
0.4328	10.2745	524	0.7159	0.6439	0.7159	0.8461
0.4328	10.3137	526	0.7049	0.6265	0.7049	0.8396
0.4328	10.3529	528	0.7394	0.6571	0.7394	0.8599
0.4328	10.3922	530	0.7790	0.6716	0.7790	0.8826
0.4328	10.4314	532	0.7749	0.6716	0.7749	0.8803
0.4328	10.4706	534	0.7087	0.6439	0.7087	0.8419
0.4328	10.5098	536	0.7027	0.5874	0.7027	0.8383
0.4328	10.5490	538	0.7366	0.6132	0.7366	0.8582
0.4328	10.5882	540	0.7692	0.6323	0.7692	0.8771
0.4328	10.6275	542	0.7832	0.6279	0.7832	0.8850
0.4328	10.6667	544	0.7347	0.6519	0.7347	0.8572
0.4328	10.7059	546	0.7288	0.6477	0.7288	0.8537
0.4328	10.7451	548	0.7572	0.6376	0.7572	0.8701
0.4328	10.7843	550	0.8222	0.6167	0.8222	0.9067
0.4328	10.8235	552	1.0381	0.5332	1.0381	1.0189
0.4328	10.8627	554	1.1430	0.4979	1.1430	1.0691
0.4328	10.9020	556	1.0141	0.5679	1.0141	1.0070
0.4328	10.9412	558	0.8214	0.5869	0.8214	0.9063
0.4328	10.9804	560	0.7879	0.5996	0.7879	0.8877
0.4328	11.0196	562	0.8105	0.6030	0.8105	0.9003
0.4328	11.0588	564	1.0290	0.5646	1.0290	1.0144
0.4328	11.0980	566	1.2281	0.5356	1.2281	1.1082
0.4328	11.1373	568	1.1476	0.5275	1.1476	1.0713
0.4328	11.1765	570	0.9993	0.5783	0.9993	0.9997
0.4328	11.2157	572	1.0311	0.5732	1.0311	1.0155
0.4328	11.2549	574	0.9752	0.5614	0.9752	0.9875
0.4328	11.2941	576	1.0037	0.5626	1.0037	1.0019
0.4328	11.3333	578	1.0835	0.5535	1.0835	1.0409
0.4328	11.3725	580	1.0873	0.5438	1.0873	1.0427
0.4328	11.4118	582	0.9903	0.5525	0.9903	0.9952

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1