ArabicNewSplits5_FineTuningAraBERT_run3_AugV5_k9_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5012
• Qwk: 0.4350
• Mse: 0.5012
• Rmse: 0.7080

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0370	2	3.2931	0.0026	3.2931	1.8147
No log	0.0741	4	1.7810	0.0168	1.7810	1.3345
No log	0.1111	6	1.2294	0.0	1.2294	1.1088
No log	0.1481	8	1.2086	0.0	1.2086	1.0993
No log	0.1852	10	1.2579	0.0	1.2579	1.1216
No log	0.2222	12	1.7949	0.0255	1.7949	1.3397
No log	0.2593	14	1.7416	0.0	1.7416	1.3197
No log	0.2963	16	1.5126	0.0	1.5126	1.2299
No log	0.3333	18	1.2193	0.0	1.2193	1.1042
No log	0.3704	20	1.2009	0.0	1.2009	1.0958
No log	0.4074	22	1.0378	0.0	1.0378	1.0187
No log	0.4444	24	1.0165	0.0038	1.0165	1.0082
No log	0.4815	26	1.1053	-0.0159	1.1053	1.0513
No log	0.5185	28	0.9916	0.0947	0.9916	0.9958
No log	0.5556	30	0.8094	0.3831	0.8094	0.8996
No log	0.5926	32	0.7136	0.3939	0.7136	0.8447
No log	0.6296	34	0.8758	0.1392	0.8758	0.9359
No log	0.6667	36	1.0693	0.0	1.0693	1.0340
No log	0.7037	38	1.1541	0.0	1.1541	1.0743
No log	0.7407	40	1.0248	0.0	1.0248	1.0123
No log	0.7778	42	0.9429	0.0345	0.9429	0.9710
No log	0.8148	44	0.7830	0.2333	0.7830	0.8849
No log	0.8519	46	0.7473	0.2281	0.7473	0.8644
No log	0.8889	48	0.8663	0.1276	0.8663	0.9308
No log	0.9259	50	0.8885	0.1333	0.8885	0.9426
No log	0.9630	52	1.2606	0.0632	1.2606	1.1228
No log	1.0	54	1.3286	0.0614	1.3286	1.1526
No log	1.0370	56	0.9895	0.1235	0.9895	0.9947
No log	1.0741	58	0.7747	0.2775	0.7747	0.8802
No log	1.1111	60	0.8471	0.2696	0.8471	0.9204
No log	1.1481	62	0.6192	0.3208	0.6192	0.7869
No log	1.1852	64	0.8220	0.3220	0.8220	0.9067
No log	1.2222	66	1.4131	0.1351	1.4131	1.1887
No log	1.2593	68	1.5084	0.0567	1.5084	1.2282
No log	1.2963	70	1.2552	0.0949	1.2552	1.1203
No log	1.3333	72	1.0078	0.2191	1.0078	1.0039
No log	1.3704	74	0.8760	0.2137	0.8760	0.9359
No log	1.4074	76	0.6232	0.3118	0.6232	0.7894
No log	1.4444	78	0.6311	0.2593	0.6311	0.7944
No log	1.4815	80	0.8801	0.1392	0.8801	0.9381
No log	1.5185	82	0.8118	0.2208	0.8118	0.9010
No log	1.5556	84	0.5155	0.1206	0.5155	0.7180
No log	1.5926	86	0.5261	-0.0081	0.5261	0.7253
No log	1.6296	88	0.5450	0.2000	0.5450	0.7383
No log	1.6667	90	0.8253	0.1416	0.8253	0.9085
No log	1.7037	92	0.9311	0.2000	0.9311	0.9649
No log	1.7407	94	1.0692	0.1181	1.0692	1.0340
No log	1.7778	96	0.7204	0.2239	0.7204	0.8488
No log	1.8148	98	0.5431	0.1895	0.5431	0.7370
No log	1.8519	100	0.5669	0.3103	0.5669	0.7529
No log	1.8889	102	0.9492	0.1347	0.9492	0.9743
No log	1.9259	104	0.9479	0.1290	0.9479	0.9736
No log	1.9630	106	0.5643	0.3103	0.5643	0.7512
No log	2.0	108	0.4484	0.3826	0.4484	0.6696
No log	2.0370	110	0.4899	0.3939	0.4899	0.7000
No log	2.0741	112	0.4898	0.4350	0.4898	0.6999
No log	2.1111	114	0.6354	0.2762	0.6354	0.7971
No log	2.1481	116	0.6102	0.2746	0.6102	0.7812
No log	2.1852	118	0.5762	0.1628	0.5762	0.7591
No log	2.2222	120	0.5529	0.2109	0.5529	0.7436
No log	2.2593	122	0.5151	0.4620	0.5151	0.7177
No log	2.2963	124	0.8937	0.1803	0.8937	0.9453
No log	2.3333	126	1.2535	0.1399	1.2535	1.1196
No log	2.3704	128	0.7751	0.1691	0.7751	0.8804
No log	2.4074	130	0.5185	0.4483	0.5185	0.7201
No log	2.4444	132	0.8170	0.1644	0.8170	0.9039
No log	2.4815	134	0.7728	0.2287	0.7728	0.8791
No log	2.5185	136	0.5167	0.4157	0.5167	0.7188
No log	2.5556	138	0.8932	0.2065	0.8932	0.9451
No log	2.5926	140	0.9523	0.2121	0.9523	0.9759
No log	2.6296	142	0.5763	0.3398	0.5763	0.7592
No log	2.6667	144	0.5403	0.5025	0.5403	0.7350
No log	2.7037	146	0.7852	0.2829	0.7852	0.8861
No log	2.7407	148	0.6384	0.3559	0.6384	0.7990
No log	2.7778	150	0.4647	0.4455	0.4647	0.6817
No log	2.8148	152	0.5190	0.48	0.5190	0.7204
No log	2.8519	154	0.6585	0.3939	0.6585	0.8115
No log	2.8889	156	0.5063	0.4526	0.5063	0.7115
No log	2.9259	158	0.4326	0.4743	0.4326	0.6577
No log	2.9630	160	0.4730	0.52	0.4730	0.6877
No log	3.0	162	0.4395	0.4762	0.4395	0.6629
No log	3.0370	164	0.4178	0.4350	0.4178	0.6464
No log	3.0741	166	0.6388	0.3585	0.6388	0.7993
No log	3.1111	168	1.0100	0.2727	1.0100	1.0050
No log	3.1481	170	0.8639	0.2409	0.8639	0.9295
No log	3.1852	172	0.5100	0.4400	0.5100	0.7141
No log	3.2222	174	0.4581	0.4526	0.4581	0.6768
No log	3.2593	176	0.4872	0.5183	0.4872	0.6980
No log	3.2963	178	0.4853	0.4652	0.4853	0.6966
No log	3.3333	180	0.4788	0.4652	0.4788	0.6920
No log	3.3704	182	0.5403	0.4171	0.5403	0.7351
No log	3.4074	184	0.5566	0.4171	0.5566	0.7460
No log	3.4444	186	0.5051	0.3684	0.5051	0.7107
No log	3.4815	188	0.5089	0.4051	0.5089	0.7133
No log	3.5185	190	0.6481	0.3831	0.6481	0.8050
No log	3.5556	192	0.7214	0.3607	0.7214	0.8493
No log	3.5926	194	0.5818	0.3231	0.5818	0.7628
No log	3.6296	196	0.5181	0.4475	0.5181	0.7198
No log	3.6667	198	0.5226	0.4043	0.5226	0.7229
No log	3.7037	200	0.5334	0.4043	0.5334	0.7304
No log	3.7407	202	0.5225	0.4091	0.5225	0.7229
No log	3.7778	204	0.6007	0.3149	0.6007	0.7750
No log	3.8148	206	0.7047	0.2762	0.7047	0.8395
No log	3.8519	208	0.5933	0.3043	0.5933	0.7702
No log	3.8889	210	0.5572	0.3846	0.5572	0.7464
No log	3.9259	212	0.5761	0.3191	0.5761	0.7590
No log	3.9630	214	0.6300	0.2821	0.6300	0.7937
No log	4.0	216	0.7006	0.3171	0.7006	0.8370
No log	4.0370	218	0.6121	0.3061	0.6121	0.7824
No log	4.0741	220	0.5362	0.3797	0.5362	0.7322
No log	4.1111	222	0.5543	0.4343	0.5543	0.7445
No log	4.1481	224	0.4996	0.2663	0.4996	0.7069
No log	4.1852	226	0.6540	0.3769	0.6540	0.8087
No log	4.2222	228	0.6647	0.3663	0.6647	0.8153
No log	4.2593	230	0.5296	0.3369	0.5296	0.7277
No log	4.2963	232	0.5155	0.3878	0.5155	0.7180
No log	4.3333	234	0.4979	0.3831	0.4979	0.7056
No log	4.3704	236	0.5154	0.3905	0.5154	0.7179
No log	4.4074	238	0.5304	0.4233	0.5304	0.7283
No log	4.4444	240	0.5091	0.4051	0.5091	0.7135
No log	4.4815	242	0.6698	0.4439	0.6698	0.8184
No log	4.5185	244	0.6408	0.4439	0.6408	0.8005
No log	4.5556	246	0.4808	0.4286	0.4808	0.6934
No log	4.5926	248	0.5789	0.4812	0.5789	0.7608
No log	4.6296	250	0.5656	0.5229	0.5656	0.7521
No log	4.6667	252	0.4467	0.5862	0.4467	0.6683
No log	4.7037	254	0.4781	0.3862	0.4781	0.6915
No log	4.7407	256	0.6049	0.4185	0.6049	0.7778
No log	4.7778	258	0.6305	0.4234	0.6305	0.7940
No log	4.8148	260	0.5191	0.4462	0.5191	0.7205
No log	4.8519	262	0.4493	0.3548	0.4493	0.6703
No log	4.8889	264	0.4581	0.3548	0.4581	0.6769
No log	4.9259	266	0.4632	0.3548	0.4632	0.6806
No log	4.9630	268	0.4987	0.3862	0.4987	0.7062
No log	5.0	270	0.6452	0.3514	0.6452	0.8032
No log	5.0370	272	0.8247	0.3811	0.8247	0.9082
No log	5.0741	274	0.6794	0.3455	0.6794	0.8242
No log	5.1111	276	0.4818	0.4098	0.4818	0.6941
No log	5.1481	278	0.4666	0.4627	0.4666	0.6831
No log	5.1852	280	0.5385	0.4444	0.5385	0.7338
No log	5.2222	282	0.5119	0.5349	0.5119	0.7155
No log	5.2593	284	0.4803	0.4573	0.4803	0.6931
No log	5.2963	286	0.5760	0.375	0.5760	0.7589
No log	5.3333	288	0.7009	0.4239	0.7009	0.8372
No log	5.3704	290	0.6427	0.4118	0.6427	0.8017
No log	5.4074	292	0.5131	0.4286	0.5131	0.7163
No log	5.4444	294	0.5584	0.3585	0.5584	0.7473
No log	5.4815	296	0.5605	0.3623	0.5605	0.7487
No log	5.5185	298	0.5423	0.3295	0.5423	0.7364
No log	5.5556	300	0.6810	0.2475	0.6810	0.8252
No log	5.5926	302	0.7067	0.2963	0.7067	0.8407
No log	5.6296	304	0.6015	0.3333	0.6015	0.7755
No log	5.6667	306	0.5592	0.4162	0.5592	0.7478
No log	5.7037	308	0.5177	0.3708	0.5177	0.7195
No log	5.7407	310	0.5064	0.3778	0.5064	0.7116
No log	5.7778	312	0.4943	0.4475	0.4943	0.7031
No log	5.8148	314	0.5605	0.375	0.5605	0.7487
No log	5.8519	316	0.6947	0.3305	0.6947	0.8335
No log	5.8889	318	0.7181	0.3305	0.7181	0.8474
No log	5.9259	320	0.5647	0.3263	0.5647	0.7515
No log	5.9630	322	0.4795	0.4894	0.4795	0.6925
No log	6.0	324	0.5360	0.4343	0.5360	0.7321
No log	6.0370	326	0.5416	0.4462	0.5416	0.7359
No log	6.0741	328	0.4908	0.4536	0.4908	0.7006
No log	6.1111	330	0.5188	0.4222	0.5188	0.7203
No log	6.1481	332	0.6384	0.3561	0.6384	0.7990
No log	6.1852	334	0.6213	0.3561	0.6213	0.7882
No log	6.2222	336	0.5161	0.3708	0.5161	0.7184
No log	6.2593	338	0.4748	0.4607	0.4748	0.6890
No log	6.2963	340	0.4769	0.4607	0.4769	0.6906
No log	6.3333	342	0.4758	0.3810	0.4758	0.6898
No log	6.3704	344	0.4895	0.3609	0.4895	0.6996
No log	6.4074	346	0.5155	0.3953	0.5155	0.7180
No log	6.4444	348	0.5807	0.3369	0.5807	0.7620
No log	6.4815	350	0.5735	0.3591	0.5735	0.7573
No log	6.5185	352	0.5873	0.3591	0.5873	0.7664
No log	6.5556	354	0.5396	0.3591	0.5396	0.7346
No log	6.5926	356	0.4912	0.4483	0.4912	0.7009
No log	6.6296	358	0.4849	0.4483	0.4849	0.6963
No log	6.6667	360	0.5130	0.4222	0.5130	0.7163
No log	6.7037	362	0.5145	0.4222	0.5145	0.7173
No log	6.7407	364	0.5229	0.3829	0.5229	0.7231
No log	6.7778	366	0.4984	0.4350	0.4984	0.7060
No log	6.8148	368	0.4873	0.4725	0.4873	0.6980
No log	6.8519	370	0.4890	0.4725	0.4890	0.6993
No log	6.8889	372	0.5092	0.4162	0.5092	0.7136
No log	6.9259	374	0.5902	0.3641	0.5902	0.7682
No log	6.9630	376	0.7379	0.3115	0.7379	0.8590
No log	7.0	378	0.7628	0.3651	0.7628	0.8734
No log	7.0370	380	0.6646	0.3208	0.6646	0.8152
No log	7.0741	382	0.5514	0.3990	0.5514	0.7426
No log	7.1111	384	0.5838	0.4171	0.5838	0.7641
No log	7.1481	386	0.6837	0.2275	0.6837	0.8269
No log	7.1852	388	0.6857	0.2632	0.6857	0.8281
No log	7.2222	390	0.6118	0.4118	0.6118	0.7822
No log	7.2593	392	0.5476	0.3730	0.5476	0.7400
No log	7.2963	394	0.5605	0.3617	0.5605	0.7487
No log	7.3333	396	0.5733	0.3402	0.5733	0.7572
No log	7.3704	398	0.5410	0.3617	0.5410	0.7355
No log	7.4074	400	0.5140	0.4400	0.5140	0.7169
No log	7.4444	402	0.5094	0.4694	0.5094	0.7137
No log	7.4815	404	0.5026	0.4975	0.5026	0.7090
No log	7.5185	406	0.5000	0.4105	0.5000	0.7071
No log	7.5556	408	0.5042	0.3730	0.5042	0.7101
No log	7.5926	410	0.4985	0.3730	0.4985	0.7061
No log	7.6296	412	0.4918	0.3730	0.4918	0.7013
No log	7.6667	414	0.4848	0.4348	0.4848	0.6963
No log	7.7037	416	0.4861	0.4725	0.4861	0.6972
No log	7.7407	418	0.4822	0.4023	0.4822	0.6944
No log	7.7778	420	0.4896	0.3778	0.4896	0.6997
No log	7.8148	422	0.5182	0.3258	0.5182	0.7199
No log	7.8519	424	0.5330	0.3149	0.5330	0.7301
No log	7.8889	426	0.5227	0.3149	0.5227	0.7230
No log	7.9259	428	0.5083	0.3661	0.5083	0.7130
No log	7.9630	430	0.4826	0.3778	0.4826	0.6947
No log	8.0	432	0.4753	0.3778	0.4753	0.6894
No log	8.0370	434	0.4714	0.4413	0.4714	0.6866
No log	8.0741	436	0.4728	0.4545	0.4728	0.6876
No log	8.1111	438	0.4759	0.4413	0.4759	0.6898
No log	8.1481	440	0.4862	0.4350	0.4862	0.6972
No log	8.1852	442	0.4915	0.4350	0.4915	0.7011
No log	8.2222	444	0.5148	0.3661	0.5148	0.7175
No log	8.2593	446	0.5325	0.3661	0.5325	0.7297
No log	8.2963	448	0.5498	0.3548	0.5498	0.7415
No log	8.3333	450	0.5302	0.3661	0.5302	0.7282
No log	8.3704	452	0.5032	0.4222	0.5032	0.7094
No log	8.4074	454	0.5010	0.4350	0.5010	0.7078
No log	8.4444	456	0.4962	0.4350	0.4962	0.7044
No log	8.4815	458	0.5026	0.3953	0.5026	0.7090
No log	8.5185	460	0.5063	0.3953	0.5063	0.7116
No log	8.5556	462	0.5133	0.3371	0.5133	0.7164
No log	8.5926	464	0.5143	0.3371	0.5143	0.7172
No log	8.6296	466	0.5043	0.3953	0.5043	0.7101
No log	8.6667	468	0.4913	0.3953	0.4913	0.7009
No log	8.7037	470	0.4765	0.3609	0.4765	0.6903
No log	8.7407	472	0.4701	0.3609	0.4701	0.6856
No log	8.7778	474	0.4714	0.3609	0.4714	0.6866
No log	8.8148	476	0.4748	0.3609	0.4748	0.6890
No log	8.8519	478	0.4786	0.3609	0.4786	0.6918
No log	8.8889	480	0.4892	0.3953	0.4892	0.6994
No log	8.9259	482	0.4982	0.3953	0.4982	0.7058
No log	8.9630	484	0.5124	0.3953	0.5124	0.7158
No log	9.0	486	0.5246	0.3258	0.5246	0.7243
No log	9.0370	488	0.5172	0.3953	0.5172	0.7192
No log	9.0741	490	0.4997	0.3953	0.4997	0.7069
No log	9.1111	492	0.4908	0.4350	0.4908	0.7006
No log	9.1481	494	0.4881	0.4350	0.4881	0.6986
No log	9.1852	496	0.4896	0.4350	0.4896	0.6997
No log	9.2222	498	0.4963	0.4350	0.4963	0.7045
0.3994	9.2593	500	0.5061	0.4350	0.5061	0.7114
0.3994	9.2963	502	0.5238	0.3258	0.5238	0.7238
0.3994	9.3333	504	0.5457	0.3149	0.5457	0.7387
0.3994	9.3704	506	0.5655	0.3043	0.5655	0.7520
0.3994	9.4074	508	0.5733	0.3043	0.5733	0.7572
0.3994	9.4444	510	0.5744	0.3043	0.5744	0.7579
0.3994	9.4815	512	0.5831	0.3684	0.5831	0.7636
0.3994	9.5185	514	0.5802	0.3797	0.5802	0.7617
0.3994	9.5556	516	0.5704	0.3043	0.5704	0.7552
0.3994	9.5926	518	0.5520	0.3149	0.5520	0.7429
0.3994	9.6296	520	0.5362	0.3258	0.5362	0.7323
0.3994	9.6667	522	0.5215	0.3258	0.5215	0.7221
0.3994	9.7037	524	0.5127	0.4350	0.5127	0.7160
0.3994	9.7407	526	0.5075	0.4350	0.5075	0.7124
0.3994	9.7778	528	0.5042	0.4350	0.5042	0.7100
0.3994	9.8148	530	0.5031	0.4350	0.5031	0.7093
0.3994	9.8519	532	0.5025	0.4350	0.5025	0.7089
0.3994	9.8889	534	0.5010	0.4350	0.5010	0.7078
0.3994	9.9259	536	0.5013	0.4350	0.5013	0.7080
0.3994	9.9630	538	0.5013	0.4350	0.5013	0.7080
0.3994	10.0	540	0.5012	0.4350	0.5012	0.7080

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1