ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run3_AugV5_k15_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4342
• Qwk: 0.4303
• Mse: 1.4342
• Rmse: 1.1976

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0274	2	5.4241	-0.0339	5.4241	2.3290
No log	0.0548	4	3.2173	0.0700	3.2173	1.7937
No log	0.0822	6	2.8343	-0.1321	2.8343	1.6835
No log	0.1096	8	2.8839	-0.1565	2.8839	1.6982
No log	0.1370	10	2.4133	-0.0988	2.4133	1.5535
No log	0.1644	12	1.9059	-0.0548	1.9059	1.3805
No log	0.1918	14	1.3141	0.1351	1.3141	1.1463
No log	0.2192	16	1.2165	0.1728	1.2165	1.1030
No log	0.2466	18	1.3707	0.0632	1.3707	1.1708
No log	0.2740	20	1.8188	0.0288	1.8188	1.3486
No log	0.3014	22	2.2172	-0.0237	2.2172	1.4890
No log	0.3288	24	1.9312	0.0251	1.9312	1.3897
No log	0.3562	26	1.4221	0.0290	1.4221	1.1925
No log	0.3836	28	1.1666	0.3242	1.1666	1.0801
No log	0.4110	30	1.1004	0.2939	1.1004	1.0490
No log	0.4384	32	1.0948	0.3266	1.0948	1.0463
No log	0.4658	34	1.0828	0.3087	1.0828	1.0406
No log	0.4932	36	1.1502	0.2590	1.1502	1.0725
No log	0.5205	38	1.2946	0.2594	1.2946	1.1378
No log	0.5479	40	1.4440	0.0645	1.4440	1.2017
No log	0.5753	42	1.3653	0.1424	1.3653	1.1685
No log	0.6027	44	1.2663	0.2263	1.2663	1.1253
No log	0.6301	46	1.1350	0.2847	1.1350	1.0654
No log	0.6575	48	1.1487	0.2917	1.1487	1.0718
No log	0.6849	50	1.1845	0.2909	1.1845	1.0883
No log	0.7123	52	1.2423	0.3473	1.2423	1.1146
No log	0.7397	54	1.6637	0.2321	1.6637	1.2899
No log	0.7671	56	2.1153	0.2278	2.1153	1.4544
No log	0.7945	58	2.3962	0.2041	2.3962	1.5480
No log	0.8219	60	2.2160	0.2200	2.2160	1.4886
No log	0.8493	62	1.8378	0.2104	1.8378	1.3557
No log	0.8767	64	1.2348	0.3004	1.2348	1.1112
No log	0.9041	66	0.9597	0.4343	0.9597	0.9796
No log	0.9315	68	0.9597	0.4135	0.9597	0.9796
No log	0.9589	70	1.0380	0.3718	1.0380	1.0188
No log	0.9863	72	1.0483	0.3652	1.0483	1.0239
No log	1.0137	74	0.9982	0.3855	0.9982	0.9991
No log	1.0411	76	0.9629	0.3681	0.9629	0.9813
No log	1.0685	78	1.0360	0.3519	1.0360	1.0178
No log	1.0959	80	1.4803	0.2923	1.4803	1.2167
No log	1.1233	82	1.9171	0.1981	1.9171	1.3846
No log	1.1507	84	2.0940	0.1898	2.0940	1.4471
No log	1.1781	86	1.7886	0.2826	1.7886	1.3374
No log	1.2055	88	1.4346	0.3313	1.4346	1.1978
No log	1.2329	90	1.1797	0.3828	1.1797	1.0861
No log	1.2603	92	1.1081	0.4011	1.1081	1.0527
No log	1.2877	94	1.2066	0.3768	1.2066	1.0985
No log	1.3151	96	1.3617	0.3677	1.3617	1.1669
No log	1.3425	98	1.3406	0.3733	1.3406	1.1578
No log	1.3699	100	1.2476	0.3681	1.2476	1.1170
No log	1.3973	102	1.1628	0.4073	1.1628	1.0783
No log	1.4247	104	1.1209	0.4093	1.1209	1.0587
No log	1.4521	106	0.9532	0.4870	0.9532	0.9763
No log	1.4795	108	0.8452	0.4869	0.8452	0.9194
No log	1.5068	110	0.8371	0.5430	0.8371	0.9149
No log	1.5342	112	0.8477	0.5466	0.8477	0.9207
No log	1.5616	114	0.9478	0.5371	0.9478	0.9735
No log	1.5890	116	1.2010	0.3753	1.2010	1.0959
No log	1.6164	118	1.4765	0.2656	1.4765	1.2151
No log	1.6438	120	1.4893	0.2619	1.4893	1.2204
No log	1.6712	122	1.2677	0.3411	1.2677	1.1259
No log	1.6986	124	1.2124	0.3316	1.2124	1.1011
No log	1.7260	126	1.1270	0.3525	1.1270	1.0616
No log	1.7534	128	1.0620	0.3617	1.0620	1.0306
No log	1.7808	130	1.0050	0.3934	1.0050	1.0025
No log	1.8082	132	0.9404	0.4549	0.9404	0.9697
No log	1.8356	134	0.8796	0.5211	0.8796	0.9379
No log	1.8630	136	0.8794	0.5060	0.8794	0.9378
No log	1.8904	138	0.8477	0.4975	0.8477	0.9207
No log	1.9178	140	0.8336	0.5507	0.8336	0.9130
No log	1.9452	142	0.9322	0.5045	0.9322	0.9655
No log	1.9726	144	1.0846	0.5082	1.0846	1.0415
No log	2.0	146	1.4007	0.4422	1.4007	1.1835
No log	2.0274	148	1.4525	0.4343	1.4525	1.2052
No log	2.0548	150	1.2582	0.4844	1.2582	1.1217
No log	2.0822	152	1.0291	0.5000	1.0291	1.0145
No log	2.1096	154	0.8320	0.6002	0.8320	0.9121
No log	2.1370	156	0.8766	0.5570	0.8766	0.9363
No log	2.1644	158	0.9921	0.5642	0.9921	0.9960
No log	2.1918	160	1.0201	0.5245	1.0201	1.0100
No log	2.2192	162	0.9788	0.5778	0.9788	0.9894
No log	2.2466	164	0.8084	0.6131	0.8084	0.8991
No log	2.2740	166	0.8161	0.6102	0.8161	0.9034
No log	2.3014	168	1.0668	0.5006	1.0668	1.0329
No log	2.3288	170	1.2055	0.4988	1.2055	1.0980
No log	2.3562	172	1.3629	0.4723	1.3629	1.1674
No log	2.3836	174	1.0366	0.4866	1.0366	1.0181
No log	2.4110	176	0.7316	0.6548	0.7316	0.8553
No log	2.4384	178	0.7840	0.6126	0.7840	0.8854
No log	2.4658	180	0.9270	0.5892	0.9270	0.9628
No log	2.4932	182	1.0072	0.5512	1.0072	1.0036
No log	2.5205	184	0.9453	0.5641	0.9453	0.9723
No log	2.5479	186	0.8298	0.6261	0.8298	0.9109
No log	2.5753	188	0.7460	0.6154	0.7460	0.8637
No log	2.6027	190	0.7322	0.5991	0.7322	0.8557
No log	2.6301	192	0.7689	0.6039	0.7689	0.8769
No log	2.6575	194	0.7966	0.5999	0.7966	0.8925
No log	2.6849	196	0.7654	0.6029	0.7654	0.8749
No log	2.7123	198	0.7443	0.5941	0.7443	0.8628
No log	2.7397	200	0.7420	0.6198	0.7420	0.8614
No log	2.7671	202	0.7633	0.5933	0.7633	0.8737
No log	2.7945	204	0.7814	0.5505	0.7814	0.8840
No log	2.8219	206	0.8173	0.5592	0.8173	0.9040
No log	2.8493	208	0.8610	0.5866	0.8610	0.9279
No log	2.8767	210	0.8581	0.6018	0.8581	0.9264
No log	2.9041	212	0.8224	0.5608	0.8224	0.9068
No log	2.9315	214	0.8207	0.5513	0.8207	0.9059
No log	2.9589	216	0.8474	0.5449	0.8474	0.9205
No log	2.9863	218	0.8660	0.5573	0.8660	0.9306
No log	3.0137	220	0.9340	0.5954	0.9340	0.9665
No log	3.0411	222	0.9299	0.5992	0.9299	0.9643
No log	3.0685	224	0.8808	0.5980	0.8808	0.9385
No log	3.0959	226	0.8191	0.5766	0.8191	0.9050
No log	3.1233	228	0.8094	0.5532	0.8094	0.8997
No log	3.1507	230	0.8363	0.5277	0.8363	0.9145
No log	3.1781	232	0.8181	0.5304	0.8181	0.9045
No log	3.2055	234	0.8230	0.5679	0.8230	0.9072
No log	3.2329	236	0.8445	0.5224	0.8445	0.9190
No log	3.2603	238	0.8686	0.6046	0.8686	0.9320
No log	3.2877	240	1.0920	0.5429	1.0920	1.0450
No log	3.3151	242	1.0344	0.5490	1.0344	1.0170
No log	3.3425	244	0.8241	0.5823	0.8241	0.9078
No log	3.3699	246	0.8872	0.5611	0.8872	0.9419
No log	3.3973	248	1.0130	0.5706	1.0130	1.0065
No log	3.4247	250	0.9121	0.5174	0.9121	0.9550
No log	3.4521	252	0.7662	0.5640	0.7662	0.8753
No log	3.4795	254	0.7825	0.5859	0.7825	0.8846
No log	3.5068	256	0.9138	0.5662	0.9138	0.9559
No log	3.5342	258	0.9908	0.5232	0.9908	0.9954
No log	3.5616	260	1.0046	0.5347	1.0046	1.0023
No log	3.5890	262	0.9161	0.5548	0.9161	0.9571
No log	3.6164	264	0.8314	0.5849	0.8314	0.9118
No log	3.6438	266	0.8062	0.5828	0.8062	0.8979
No log	3.6712	268	0.8389	0.6146	0.8389	0.9159
No log	3.6986	270	0.8192	0.5999	0.8192	0.9051
No log	3.7260	272	0.8006	0.5999	0.8006	0.8948
No log	3.7534	274	0.7863	0.6001	0.7863	0.8867
No log	3.7808	276	0.8460	0.5804	0.8460	0.9198
No log	3.8082	278	0.9878	0.4939	0.9878	0.9939
No log	3.8356	280	1.0962	0.5021	1.0962	1.0470
No log	3.8630	282	1.1068	0.5007	1.1068	1.0520
No log	3.8904	284	1.0624	0.4942	1.0624	1.0308
No log	3.9178	286	1.0041	0.5287	1.0041	1.0021
No log	3.9452	288	0.8922	0.5493	0.8922	0.9446
No log	3.9726	290	0.8116	0.6055	0.8116	0.9009
No log	4.0	292	0.7825	0.5796	0.7825	0.8846
No log	4.0274	294	0.7623	0.5920	0.7623	0.8731
No log	4.0548	296	0.7719	0.6062	0.7719	0.8786
No log	4.0822	298	0.8257	0.5806	0.8257	0.9087
No log	4.1096	300	0.9352	0.5329	0.9352	0.9670
No log	4.1370	302	0.9327	0.5392	0.9327	0.9658
No log	4.1644	304	0.8358	0.5818	0.8358	0.9142
No log	4.1918	306	0.7466	0.6313	0.7466	0.8641
No log	4.2192	308	0.7337	0.6410	0.7337	0.8565
No log	4.2466	310	0.7460	0.6275	0.7460	0.8637
No log	4.2740	312	0.7727	0.6006	0.7727	0.8790
No log	4.3014	314	0.9044	0.5557	0.9044	0.9510
No log	4.3288	316	1.1197	0.5166	1.1197	1.0582
No log	4.3562	318	1.2738	0.4613	1.2738	1.1286
No log	4.3836	320	1.2519	0.4829	1.2519	1.1189
No log	4.4110	322	1.0633	0.5260	1.0633	1.0312
No log	4.4384	324	0.8332	0.6060	0.8332	0.9128
No log	4.4658	326	0.7973	0.5990	0.7973	0.8929
No log	4.4932	328	0.7903	0.5889	0.7903	0.8890
No log	4.5205	330	0.7616	0.5993	0.7616	0.8727
No log	4.5479	332	0.7833	0.5947	0.7833	0.8850
No log	4.5753	334	0.8322	0.5972	0.8322	0.9123
No log	4.6027	336	0.8362	0.5826	0.8362	0.9144
No log	4.6301	338	0.7945	0.5857	0.7945	0.8914
No log	4.6575	340	0.7557	0.5738	0.7557	0.8693
No log	4.6849	342	0.7284	0.5950	0.7284	0.8535
No log	4.7123	344	0.7226	0.6323	0.7226	0.8500
No log	4.7397	346	0.7268	0.6141	0.7268	0.8525
No log	4.7671	348	0.7920	0.5256	0.7920	0.8900
No log	4.7945	350	1.0256	0.5299	1.0256	1.0127
No log	4.8219	352	1.1870	0.4747	1.1870	1.0895
No log	4.8493	354	1.2002	0.4828	1.2002	1.0955
No log	4.8767	356	1.0658	0.5101	1.0658	1.0324
No log	4.9041	358	0.9661	0.5742	0.9661	0.9829
No log	4.9315	360	0.9620	0.5815	0.9620	0.9808
No log	4.9589	362	1.0531	0.5633	1.0531	1.0262
No log	4.9863	364	1.0957	0.5286	1.0957	1.0467
No log	5.0137	366	1.0850	0.5338	1.0850	1.0416
No log	5.0411	368	1.0877	0.5128	1.0877	1.0429
No log	5.0685	370	1.1431	0.4936	1.1431	1.0692
No log	5.0959	372	1.3236	0.4455	1.3236	1.1505
No log	5.1233	374	1.4752	0.3641	1.4752	1.2146
No log	5.1507	376	1.4252	0.3850	1.4252	1.1938
No log	5.1781	378	1.2053	0.4501	1.2053	1.0979
No log	5.2055	380	0.9910	0.5581	0.9910	0.9955
No log	5.2329	382	0.9226	0.5934	0.9226	0.9605
No log	5.2603	384	0.8915	0.5935	0.8915	0.9442
No log	5.2877	386	0.9670	0.5753	0.9670	0.9833
No log	5.3151	388	1.1171	0.5321	1.1171	1.0569
No log	5.3425	390	1.1020	0.5741	1.1020	1.0498
No log	5.3699	392	1.1399	0.5425	1.1399	1.0677
No log	5.3973	394	1.1955	0.5155	1.1955	1.0934
No log	5.4247	396	1.0920	0.5134	1.0920	1.0450
No log	5.4521	398	0.9864	0.5216	0.9864	0.9932
No log	5.4795	400	0.9037	0.5320	0.9037	0.9506
No log	5.5068	402	0.8805	0.5463	0.8805	0.9384
No log	5.5342	404	0.8771	0.5486	0.8771	0.9366
No log	5.5616	406	0.8814	0.6011	0.8814	0.9388
No log	5.5890	408	0.8395	0.6091	0.8395	0.9162
No log	5.6164	410	0.8424	0.6241	0.8424	0.9178
No log	5.6438	412	0.9268	0.5639	0.9268	0.9627
No log	5.6712	414	1.1021	0.4971	1.1021	1.0498
No log	5.6986	416	1.2086	0.4903	1.2086	1.0993
No log	5.7260	418	1.1475	0.4971	1.1475	1.0712
No log	5.7534	420	1.0505	0.5155	1.0505	1.0250
No log	5.7808	422	0.9972	0.5253	0.9972	0.9986
No log	5.8082	424	0.9341	0.5534	0.9341	0.9665
No log	5.8356	426	0.9878	0.5592	0.9879	0.9939
No log	5.8630	428	1.0541	0.5731	1.0541	1.0267
No log	5.8904	430	1.0357	0.5825	1.0357	1.0177
No log	5.9178	432	0.9785	0.5956	0.9785	0.9892
No log	5.9452	434	0.8679	0.6049	0.8679	0.9316
No log	5.9726	436	0.7931	0.6114	0.7931	0.8906
No log	6.0	438	0.7550	0.6036	0.7550	0.8689
No log	6.0274	440	0.7454	0.6453	0.7454	0.8634
No log	6.0548	442	0.7479	0.6436	0.7479	0.8648
No log	6.0822	444	0.7658	0.6327	0.7658	0.8751
No log	6.1096	446	0.8526	0.5803	0.8526	0.9233
No log	6.1370	448	0.9616	0.5446	0.9616	0.9806
No log	6.1644	450	0.9365	0.5454	0.9365	0.9677
No log	6.1918	452	0.8529	0.5621	0.8529	0.9235
No log	6.2192	454	0.7884	0.5898	0.7884	0.8879
No log	6.2466	456	0.7566	0.5872	0.7566	0.8698
No log	6.2740	458	0.7884	0.5492	0.7884	0.8879
No log	6.3014	460	0.7828	0.6132	0.7828	0.8848
No log	6.3288	462	0.7774	0.6148	0.7774	0.8817
No log	6.3562	464	0.7988	0.5939	0.7988	0.8937
No log	6.3836	466	0.8007	0.6099	0.8007	0.8948
No log	6.4110	468	0.8112	0.6079	0.8112	0.9007
No log	6.4384	470	0.9288	0.5247	0.9288	0.9638
No log	6.4658	472	1.0515	0.5229	1.0515	1.0254
No log	6.4932	474	1.0911	0.4943	1.0911	1.0446
No log	6.5205	476	1.1406	0.4652	1.1406	1.0680
No log	6.5479	478	1.1275	0.4755	1.1275	1.0618
No log	6.5753	480	1.0940	0.5163	1.0940	1.0459
No log	6.6027	482	0.9352	0.5719	0.9352	0.9670
No log	6.6301	484	0.8179	0.6143	0.8179	0.9044
No log	6.6575	486	0.8642	0.6241	0.8642	0.9296
No log	6.6849	488	0.9283	0.6166	0.9283	0.9635
No log	6.7123	490	1.0792	0.5543	1.0792	1.0388
No log	6.7397	492	1.1565	0.5306	1.1565	1.0754
No log	6.7671	494	1.2049	0.5279	1.2049	1.0977
No log	6.7945	496	1.1066	0.4992	1.1066	1.0520
No log	6.8219	498	0.9919	0.5333	0.9919	0.9960
0.468	6.8493	500	1.0055	0.5245	1.0055	1.0028
0.468	6.8767	502	1.0046	0.5308	1.0046	1.0023
0.468	6.9041	504	0.9039	0.5728	0.9039	0.9507
0.468	6.9315	506	0.7984	0.6362	0.7984	0.8935
0.468	6.9589	508	0.7766	0.6362	0.7766	0.8812
0.468	6.9863	510	0.8437	0.6172	0.8437	0.9185
0.468	7.0137	512	1.0259	0.5188	1.0259	1.0129
0.468	7.0411	514	1.3055	0.4659	1.3055	1.1426
0.468	7.0685	516	1.5696	0.4576	1.5696	1.2528
0.468	7.0959	518	1.5971	0.4458	1.5971	1.2638
0.468	7.1233	520	1.4342	0.4303	1.4342	1.1976

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1