ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k10_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2854
• Qwk: 0.3892
• Mse: 1.2854
• Rmse: 1.1338

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0392	2	5.3464	-0.0486	5.3464	2.3122
No log	0.0784	4	3.0565	0.0739	3.0565	1.7483
No log	0.1176	6	2.4587	-0.0740	2.4587	1.5680
No log	0.1569	8	1.7655	0.0568	1.7655	1.3287
No log	0.1961	10	1.3227	0.0747	1.3227	1.1501
No log	0.2353	12	1.3687	0.1898	1.3687	1.1699
No log	0.2745	14	1.4688	0.2052	1.4688	1.2119
No log	0.3137	16	1.4325	0.0537	1.4325	1.1969
No log	0.3529	18	1.6402	0.0282	1.6402	1.2807
No log	0.3922	20	1.5998	0.0524	1.5998	1.2648
No log	0.4314	22	1.4380	0.0962	1.4380	1.1992
No log	0.4706	24	1.2933	0.1532	1.2933	1.1372
No log	0.5098	26	1.2445	0.1459	1.2445	1.1156
No log	0.5490	28	1.2408	0.2383	1.2408	1.1139
No log	0.5882	30	1.2376	0.1843	1.2376	1.1125
No log	0.6275	32	1.2456	0.0958	1.2456	1.1161
No log	0.6667	34	1.2837	0.0958	1.2837	1.1330
No log	0.7059	36	1.2994	0.0599	1.2994	1.1399
No log	0.7451	38	1.2921	0.0368	1.2921	1.1367
No log	0.7843	40	1.2511	0.1584	1.2511	1.1185
No log	0.8235	42	1.3150	0.2166	1.3150	1.1467
No log	0.8627	44	1.3695	0.0549	1.3695	1.1702
No log	0.9020	46	1.3464	0.0974	1.3464	1.1604
No log	0.9412	48	1.2550	0.2382	1.2550	1.1203
No log	0.9804	50	1.1841	0.3362	1.1841	1.0881
No log	1.0196	52	1.1632	0.3331	1.1632	1.0785
No log	1.0588	54	1.1720	0.3565	1.1720	1.0826
No log	1.0980	56	1.1524	0.2845	1.1524	1.0735
No log	1.1373	58	1.2284	0.1936	1.2284	1.1083
No log	1.1765	60	1.2121	0.2082	1.2121	1.1010
No log	1.2157	62	1.2193	0.2082	1.2193	1.1042
No log	1.2549	64	1.2171	0.2299	1.2171	1.1032
No log	1.2941	66	1.1676	0.2132	1.1676	1.0806
No log	1.3333	68	1.1304	0.2835	1.1304	1.0632
No log	1.3725	70	1.0773	0.2969	1.0773	1.0379
No log	1.4118	72	1.0515	0.2856	1.0515	1.0254
No log	1.4510	74	1.0860	0.3017	1.0860	1.0421
No log	1.4902	76	1.0919	0.3235	1.0919	1.0449
No log	1.5294	78	1.0799	0.3674	1.0799	1.0392
No log	1.5686	80	0.9992	0.3950	0.9992	0.9996
No log	1.6078	82	0.9460	0.3486	0.9460	0.9726
No log	1.6471	84	0.9891	0.3829	0.9891	0.9945
No log	1.6863	86	0.9649	0.3705	0.9649	0.9823
No log	1.7255	88	0.9392	0.3725	0.9392	0.9691
No log	1.7647	90	1.1174	0.4834	1.1174	1.0571
No log	1.8039	92	1.2876	0.3838	1.2876	1.1347
No log	1.8431	94	1.1463	0.4290	1.1463	1.0706
No log	1.8824	96	1.0851	0.3790	1.0851	1.0417
No log	1.9216	98	1.1860	0.4005	1.1860	1.0890
No log	1.9608	100	1.3398	0.3962	1.3398	1.1575
No log	2.0	102	1.3482	0.3942	1.3482	1.1611
No log	2.0392	104	1.3233	0.3605	1.3233	1.1503
No log	2.0784	106	1.3750	0.3706	1.3750	1.1726
No log	2.1176	108	1.4280	0.3899	1.4280	1.1950
No log	2.1569	110	1.1416	0.4473	1.1416	1.0685
No log	2.1961	112	1.0504	0.4732	1.0504	1.0249
No log	2.2353	114	1.1136	0.5113	1.1136	1.0553
No log	2.2745	116	1.2585	0.4084	1.2585	1.1218
No log	2.3137	118	1.3147	0.4084	1.3147	1.1466
No log	2.3529	120	1.1922	0.4610	1.1922	1.0919
No log	2.3922	122	0.8947	0.5534	0.8947	0.9459
No log	2.4314	124	0.8707	0.4766	0.8707	0.9331
No log	2.4706	126	0.9466	0.4880	0.9466	0.9729
No log	2.5098	128	0.8481	0.4975	0.8481	0.9209
No log	2.5490	130	0.9054	0.4567	0.9054	0.9515
No log	2.5882	132	1.0085	0.4494	1.0085	1.0042
No log	2.6275	134	0.9730	0.4570	0.9730	0.9864
No log	2.6667	136	1.0311	0.4850	1.0311	1.0154
No log	2.7059	138	1.2162	0.4854	1.2162	1.1028
No log	2.7451	140	1.5097	0.3834	1.5097	1.2287
No log	2.7843	142	1.5876	0.3209	1.5876	1.2600
No log	2.8235	144	1.5178	0.3835	1.5178	1.2320
No log	2.8627	146	1.3800	0.4508	1.3800	1.1747
No log	2.9020	148	1.1673	0.4895	1.1673	1.0804
No log	2.9412	150	1.0660	0.5231	1.0660	1.0325
No log	2.9804	152	1.0210	0.5414	1.0210	1.0104
No log	3.0196	154	1.0951	0.5302	1.0951	1.0465
No log	3.0588	156	1.1348	0.4964	1.1348	1.0653
No log	3.0980	158	1.2962	0.4644	1.2962	1.1385
No log	3.1373	160	1.4035	0.4466	1.4035	1.1847
No log	3.1765	162	1.1727	0.4838	1.1727	1.0829
No log	3.2157	164	1.0068	0.5816	1.0068	1.0034
No log	3.2549	166	1.0690	0.5693	1.0690	1.0339
No log	3.2941	168	1.0916	0.5483	1.0916	1.0448
No log	3.3333	170	1.3960	0.4698	1.3960	1.1815
No log	3.3725	172	1.3561	0.4818	1.3561	1.1645
No log	3.4118	174	1.1818	0.5142	1.1818	1.0871
No log	3.4510	176	1.1278	0.5330	1.1278	1.0620
No log	3.4902	178	0.9386	0.5525	0.9386	0.9688
No log	3.5294	180	0.8740	0.5770	0.8740	0.9349
No log	3.5686	182	0.8702	0.5652	0.8702	0.9329
No log	3.6078	184	0.8318	0.6051	0.8318	0.9120
No log	3.6471	186	0.9387	0.5486	0.9387	0.9689
No log	3.6863	188	1.0189	0.5473	1.0189	1.0094
No log	3.7255	190	1.2369	0.4875	1.2369	1.1121
No log	3.7647	192	1.4866	0.4112	1.4866	1.2193
No log	3.8039	194	1.5797	0.3624	1.5797	1.2569
No log	3.8431	196	1.4153	0.4406	1.4153	1.1896
No log	3.8824	198	0.9708	0.5421	0.9708	0.9853
No log	3.9216	200	0.7887	0.6186	0.7887	0.8881
No log	3.9608	202	0.7590	0.6347	0.7590	0.8712
No log	4.0	204	0.7253	0.6591	0.7253	0.8516
No log	4.0392	206	0.8059	0.5998	0.8059	0.8977
No log	4.0784	208	0.7904	0.6083	0.7904	0.8891
No log	4.1176	210	0.7584	0.6279	0.7584	0.8708
No log	4.1569	212	0.7130	0.6329	0.7130	0.8444
No log	4.1961	214	0.7436	0.6140	0.7436	0.8623
No log	4.2353	216	0.7964	0.5906	0.7964	0.8924
No log	4.2745	218	1.0005	0.5456	1.0005	1.0003
No log	4.3137	220	0.9763	0.5671	0.9763	0.9881
No log	4.3529	222	1.1027	0.5284	1.1027	1.0501
No log	4.3922	224	1.1364	0.5363	1.1364	1.0660
No log	4.4314	226	1.1077	0.5636	1.1077	1.0525
No log	4.4706	228	0.9680	0.5803	0.9680	0.9839
No log	4.5098	230	1.0052	0.5779	1.0052	1.0026
No log	4.5490	232	1.0303	0.5696	1.0303	1.0150
No log	4.5882	234	0.9455	0.5732	0.9455	0.9724
No log	4.6275	236	0.8240	0.6241	0.8240	0.9077
No log	4.6667	238	0.8891	0.5693	0.8891	0.9429
No log	4.7059	240	0.9989	0.5321	0.9989	0.9995
No log	4.7451	242	0.9530	0.5618	0.9530	0.9762
No log	4.7843	244	0.8032	0.6011	0.8032	0.8962
No log	4.8235	246	0.7065	0.6103	0.7065	0.8406
No log	4.8627	248	0.6536	0.6629	0.6536	0.8085
No log	4.9020	250	0.6644	0.6490	0.6644	0.8151
No log	4.9412	252	0.7519	0.6278	0.7519	0.8671
No log	4.9804	254	1.0283	0.5388	1.0283	1.0141
No log	5.0196	256	1.2826	0.5057	1.2826	1.1325
No log	5.0588	258	1.2679	0.5089	1.2679	1.1260
No log	5.0980	260	1.2010	0.5193	1.2010	1.0959
No log	5.1373	262	1.1323	0.5273	1.1323	1.0641
No log	5.1765	264	1.1568	0.5372	1.1568	1.0755
No log	5.2157	266	1.2615	0.5214	1.2615	1.1232
No log	5.2549	268	1.0071	0.5696	1.0071	1.0036
No log	5.2941	270	0.7445	0.6510	0.7445	0.8628
No log	5.3333	272	0.6954	0.6372	0.6954	0.8339
No log	5.3725	274	0.7070	0.6137	0.7070	0.8408
No log	5.4118	276	0.8667	0.5875	0.8667	0.9310
No log	5.4510	278	0.9753	0.5452	0.9753	0.9876
No log	5.4902	280	0.9180	0.5873	0.9180	0.9581
No log	5.5294	282	0.7758	0.6368	0.7758	0.8808
No log	5.5686	284	0.7324	0.6448	0.7324	0.8558
No log	5.6078	286	0.7011	0.6520	0.7011	0.8373
No log	5.6471	288	0.7132	0.6674	0.7132	0.8445
No log	5.6863	290	0.6828	0.6530	0.6828	0.8263
No log	5.7255	292	0.6796	0.6327	0.6796	0.8244
No log	5.7647	294	0.7654	0.6606	0.7654	0.8749
No log	5.8039	296	0.9298	0.5898	0.9298	0.9642
No log	5.8431	298	0.9157	0.6085	0.9157	0.9569
No log	5.8824	300	0.8926	0.6353	0.8926	0.9448
No log	5.9216	302	1.0222	0.5719	1.0222	1.0110
No log	5.9608	304	0.9687	0.5754	0.9687	0.9842
No log	6.0	306	1.0549	0.5645	1.0549	1.0271
No log	6.0392	308	1.1176	0.5191	1.1176	1.0571
No log	6.0784	310	1.0118	0.5492	1.0118	1.0059
No log	6.1176	312	0.9315	0.5501	0.9315	0.9652
No log	6.1569	314	0.9001	0.6202	0.9001	0.9488
No log	6.1961	316	0.9980	0.6096	0.9980	0.9990
No log	6.2353	318	1.1350	0.5808	1.1350	1.0653
No log	6.2745	320	0.9719	0.6112	0.9719	0.9859
No log	6.3137	322	0.7007	0.6505	0.7007	0.8371
No log	6.3529	324	0.6948	0.6008	0.6948	0.8336
No log	6.3922	326	0.7515	0.6266	0.7515	0.8669
No log	6.4314	328	1.0545	0.5525	1.0545	1.0269
No log	6.4706	330	1.2509	0.4477	1.2509	1.1184
No log	6.5098	332	1.0855	0.5292	1.0855	1.0419
No log	6.5490	334	0.8431	0.6200	0.8431	0.9182
No log	6.5882	336	0.8118	0.6360	0.8118	0.9010
No log	6.6275	338	0.9497	0.5826	0.9497	0.9745
No log	6.6667	340	1.3037	0.4512	1.3037	1.1418
No log	6.7059	342	1.4299	0.4195	1.4299	1.1958
No log	6.7451	344	1.2112	0.4918	1.2112	1.1006
No log	6.7843	346	1.0740	0.5259	1.0740	1.0364
No log	6.8235	348	1.1892	0.5107	1.1892	1.0905
No log	6.8627	350	1.2566	0.4994	1.2566	1.1210
No log	6.9020	352	1.2718	0.4889	1.2718	1.1278
No log	6.9412	354	1.0352	0.5500	1.0352	1.0175
No log	6.9804	356	0.8019	0.6139	0.8019	0.8955
No log	7.0196	358	0.7488	0.5994	0.7488	0.8653
No log	7.0588	360	0.7577	0.5848	0.7577	0.8705
No log	7.0980	362	0.7752	0.6220	0.7752	0.8804
No log	7.1373	364	0.9936	0.5333	0.9936	0.9968
No log	7.1765	366	1.4024	0.4132	1.4024	1.1842
No log	7.2157	368	1.4839	0.3867	1.4839	1.2182
No log	7.2549	370	1.2349	0.4321	1.2349	1.1113
No log	7.2941	372	0.8950	0.6069	0.8950	0.9461
No log	7.3333	374	0.7771	0.6530	0.7771	0.8815
No log	7.3725	376	0.7775	0.6366	0.7775	0.8818
No log	7.4118	378	0.9244	0.5909	0.9244	0.9615
No log	7.4510	380	0.9987	0.5730	0.9987	0.9994
No log	7.4902	382	0.9680	0.5730	0.9680	0.9839
No log	7.5294	384	0.8890	0.6078	0.8890	0.9429
No log	7.5686	386	0.8793	0.6050	0.8793	0.9377
No log	7.6078	388	0.9366	0.5416	0.9366	0.9678
No log	7.6471	390	1.0926	0.4923	1.0926	1.0453
No log	7.6863	392	1.1718	0.4853	1.1718	1.0825
No log	7.7255	394	1.0335	0.5156	1.0335	1.0166
No log	7.7647	396	0.8540	0.5865	0.8540	0.9241
No log	7.8039	398	0.7325	0.6587	0.7325	0.8558
No log	7.8431	400	0.6982	0.6620	0.6982	0.8356
No log	7.8824	402	0.7165	0.6519	0.7165	0.8465
No log	7.9216	404	0.8308	0.6490	0.8308	0.9115
No log	7.9608	406	0.9837	0.5708	0.9837	0.9918
No log	8.0	408	1.0110	0.5859	1.0110	1.0055
No log	8.0392	410	0.8437	0.6278	0.8437	0.9186
No log	8.0784	412	0.6869	0.6873	0.6869	0.8288
No log	8.1176	414	0.6755	0.6837	0.6755	0.8219
No log	8.1569	416	0.6762	0.6951	0.6762	0.8223
No log	8.1961	418	0.7367	0.6532	0.7367	0.8583
No log	8.2353	420	0.9316	0.5664	0.9316	0.9652
No log	8.2745	422	1.1620	0.4989	1.1620	1.0780
No log	8.3137	424	1.1720	0.4953	1.1720	1.0826
No log	8.3529	426	0.9917	0.5588	0.9917	0.9958
No log	8.3922	428	0.8831	0.5916	0.8831	0.9397
No log	8.4314	430	0.8721	0.5741	0.8721	0.9339
No log	8.4706	432	0.8832	0.5576	0.8832	0.9398
No log	8.5098	434	0.9761	0.5599	0.9761	0.9880
No log	8.5490	436	1.1671	0.4858	1.1671	1.0803
No log	8.5882	438	1.1349	0.4961	1.1349	1.0653
No log	8.6275	440	0.9145	0.6081	0.9145	0.9563
No log	8.6667	442	0.7609	0.6626	0.7609	0.8723
No log	8.7059	444	0.6647	0.7122	0.6647	0.8153
No log	8.7451	446	0.6568	0.7122	0.6568	0.8104
No log	8.7843	448	0.7093	0.6655	0.7093	0.8422
No log	8.8235	450	0.8364	0.6274	0.8364	0.9145
No log	8.8627	452	0.8251	0.6376	0.8251	0.9084
No log	8.9020	454	0.8687	0.6229	0.8687	0.9321
No log	8.9412	456	1.0618	0.5513	1.0618	1.0304
No log	8.9804	458	1.1469	0.5303	1.1469	1.0709
No log	9.0196	460	1.0521	0.5298	1.0521	1.0257
No log	9.0588	462	0.9066	0.5995	0.9066	0.9522
No log	9.0980	464	0.8435	0.6262	0.8435	0.9184
No log	9.1373	466	0.7793	0.6439	0.7793	0.8828
No log	9.1765	468	0.7867	0.6534	0.7867	0.8870
No log	9.2157	470	0.8483	0.6318	0.8483	0.9211
No log	9.2549	472	0.8807	0.6419	0.8807	0.9384
No log	9.2941	474	0.8129	0.6706	0.8129	0.9016
No log	9.3333	476	0.6798	0.6976	0.6798	0.8245
No log	9.3725	478	0.6541	0.6936	0.6541	0.8088
No log	9.4118	480	0.6908	0.6906	0.6908	0.8311
No log	9.4510	482	0.8232	0.6512	0.8232	0.9073
No log	9.4902	484	0.8852	0.6392	0.8852	0.9408
No log	9.5294	486	0.8975	0.6296	0.8975	0.9474
No log	9.5686	488	0.9812	0.5578	0.9812	0.9905
No log	9.6078	490	1.0332	0.5266	1.0332	1.0165
No log	9.6471	492	1.0362	0.5395	1.0362	1.0180
No log	9.6863	494	1.0644	0.5317	1.0644	1.0317
No log	9.7255	496	1.0946	0.5271	1.0946	1.0462
No log	9.7647	498	1.0926	0.5271	1.0926	1.0453
0.4744	9.8039	500	1.2718	0.4717	1.2718	1.1277
0.4744	9.8431	502	1.3470	0.4505	1.3470	1.1606
0.4744	9.8824	504	1.2007	0.5284	1.2007	1.0958
0.4744	9.9216	506	1.1803	0.5246	1.1803	1.0864
0.4744	9.9608	508	1.2123	0.5017	1.2123	1.1010
0.4744	10.0	510	1.0292	0.5451	1.0292	1.0145
0.4744	10.0392	512	0.8296	0.6080	0.8296	0.9108
0.4744	10.0784	514	0.8103	0.6114	0.8103	0.9002
0.4744	10.1176	516	0.8794	0.5512	0.8794	0.9377
0.4744	10.1569	518	1.0206	0.5448	1.0206	1.0102
0.4744	10.1961	520	1.0111	0.5733	1.0111	1.0055
0.4744	10.2353	522	0.9797	0.5783	0.9797	0.9898
0.4744	10.2745	524	0.9011	0.5923	0.9011	0.9493
0.4744	10.3137	526	0.9062	0.5835	0.9062	0.9519
0.4744	10.3529	528	0.9150	0.5745	0.9150	0.9565
0.4744	10.3922	530	0.9022	0.5692	0.9022	0.9498
0.4744	10.4314	532	0.8820	0.5877	0.8820	0.9392
0.4744	10.4706	534	0.8961	0.6016	0.8961	0.9466
0.4744	10.5098	536	0.9167	0.6001	0.9167	0.9574
0.4744	10.5490	538	0.9922	0.5632	0.9922	0.9961
0.4744	10.5882	540	1.0481	0.5443	1.0481	1.0238
0.4744	10.6275	542	0.9940	0.5746	0.9940	0.9970
0.4744	10.6667	544	0.8577	0.6078	0.8577	0.9261
0.4744	10.7059	546	0.7633	0.6	0.7633	0.8737
0.4744	10.7451	548	0.7156	0.6395	0.7156	0.8459
0.4744	10.7843	550	0.6773	0.6837	0.6773	0.8230
0.4744	10.8235	552	0.7199	0.6675	0.7199	0.8485
0.4744	10.8627	554	0.8997	0.6241	0.8997	0.9485
0.4744	10.9020	556	0.9639	0.6226	0.9639	0.9818
0.4744	10.9412	558	0.8536	0.6436	0.8536	0.9239
0.4744	10.9804	560	0.6839	0.6614	0.6839	0.8270
0.4744	11.0196	562	0.6492	0.6448	0.6492	0.8057
0.4744	11.0588	564	0.6560	0.6672	0.6560	0.8099
0.4744	11.0980	566	0.7545	0.6606	0.7545	0.8686
0.4744	11.1373	568	1.0541	0.5346	1.0541	1.0267
0.4744	11.1765	570	1.2553	0.4649	1.2553	1.1204
0.4744	11.2157	572	1.2961	0.4688	1.2961	1.1385
0.4744	11.2549	574	1.4229	0.4818	1.4229	1.1929
0.4744	11.2941	576	1.4553	0.4418	1.4553	1.2064
0.4744	11.3333	578	1.3154	0.4283	1.3154	1.1469
0.4744	11.3725	580	1.1866	0.4414	1.1866	1.0893
0.4744	11.4118	582	1.1851	0.4404	1.1851	1.0886
0.4744	11.4510	584	1.2854	0.3892	1.2854	1.1338

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1