ArabicNewSplits6_FineTuningAraBERT_run3_AugV5_k10_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8116
• Qwk: 0.4955
• Mse: 0.8116
• Rmse: 0.9009

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	4.1245	-0.0134	4.1245	2.0309
No log	0.0769	4	2.1989	0.0131	2.1989	1.4829
No log	0.1154	6	1.2689	0.0659	1.2689	1.1265
No log	0.1538	8	0.9825	-0.0117	0.9825	0.9912
No log	0.1923	10	0.7188	0.2113	0.7188	0.8478
No log	0.2308	12	0.6448	0.2548	0.6448	0.8030
No log	0.2692	14	0.6599	0.2765	0.6599	0.8123
No log	0.3077	16	1.1202	0.0997	1.1202	1.0584
No log	0.3462	18	2.2937	0.0475	2.2937	1.5145
No log	0.3846	20	1.6601	0.0906	1.6601	1.2884
No log	0.4231	22	0.7934	0.3583	0.7934	0.8907
No log	0.4615	24	0.6916	0.3434	0.6916	0.8316
No log	0.5	26	0.7866	0.3457	0.7866	0.8869
No log	0.5385	28	0.9444	0.2303	0.9444	0.9718
No log	0.5769	30	0.9870	0.1937	0.9870	0.9935
No log	0.6154	32	0.9021	0.2317	0.9021	0.9498
No log	0.6538	34	0.7455	0.2974	0.7455	0.8634
No log	0.6923	36	0.6824	0.3014	0.6824	0.8261
No log	0.7308	38	0.7090	0.4063	0.7090	0.8420
No log	0.7692	40	0.7797	0.4473	0.7797	0.8830
No log	0.8077	42	1.4140	0.2468	1.4140	1.1891
No log	0.8462	44	2.0402	0.2154	2.0402	1.4283
No log	0.8846	46	1.5116	0.2524	1.5116	1.2295
No log	0.9231	48	0.8046	0.4108	0.8046	0.8970
No log	0.9615	50	0.5347	0.5263	0.5347	0.7312
No log	1.0	52	0.5272	0.5381	0.5272	0.7261
No log	1.0385	54	0.5242	0.5486	0.5242	0.7240
No log	1.0769	56	0.6134	0.4241	0.6134	0.7832
No log	1.1154	58	1.0388	0.3121	1.0388	1.0192
No log	1.1538	60	1.2765	0.2321	1.2765	1.1298
No log	1.1923	62	1.0182	0.2984	1.0182	1.0091
No log	1.2308	64	0.6416	0.4745	0.6416	0.8010
No log	1.2692	66	0.5238	0.5283	0.5238	0.7237
No log	1.3077	68	0.5184	0.5097	0.5184	0.7200
No log	1.3462	70	0.5868	0.4673	0.5868	0.7660
No log	1.3846	72	0.8020	0.3270	0.8020	0.8955
No log	1.4231	74	1.2647	0.2633	1.2647	1.1246
No log	1.4615	76	1.3836	0.2743	1.3836	1.1763
No log	1.5	78	1.1635	0.3030	1.1635	1.0787
No log	1.5385	80	0.8344	0.4281	0.8344	0.9134
No log	1.5769	82	0.6734	0.4980	0.6734	0.8206
No log	1.6154	84	0.6113	0.4882	0.6113	0.7819
No log	1.6538	86	0.6278	0.4868	0.6278	0.7923
No log	1.6923	88	0.6328	0.4704	0.6328	0.7955
No log	1.7308	90	0.6979	0.4765	0.6979	0.8354
No log	1.7692	92	0.7088	0.4733	0.7088	0.8419
No log	1.8077	94	0.6545	0.4919	0.6545	0.8090
No log	1.8462	96	0.5761	0.5239	0.5761	0.7590
No log	1.8846	98	0.5705	0.5409	0.5705	0.7553
No log	1.9231	100	0.6772	0.5264	0.6772	0.8229
No log	1.9615	102	0.9337	0.4601	0.9337	0.9663
No log	2.0	104	1.3041	0.4417	1.3041	1.1420
No log	2.0385	106	1.1758	0.4419	1.1758	1.0843
No log	2.0769	108	0.9855	0.4611	0.9855	0.9927
No log	2.1154	110	0.9195	0.4127	0.9195	0.9589
No log	2.1538	112	0.9137	0.4316	0.9137	0.9559
No log	2.1923	114	0.8992	0.4273	0.8992	0.9483
No log	2.2308	116	1.0507	0.4325	1.0507	1.0251
No log	2.2692	118	1.1527	0.4153	1.1527	1.0737
No log	2.3077	120	1.0863	0.4207	1.0863	1.0423
No log	2.3462	122	1.0051	0.4342	1.0051	1.0026
No log	2.3846	124	1.0299	0.4237	1.0299	1.0148
No log	2.4231	126	1.0137	0.4327	1.0137	1.0068
No log	2.4615	128	0.9849	0.4342	0.9849	0.9924
No log	2.5	130	0.9053	0.4488	0.9053	0.9515
No log	2.5385	132	0.8818	0.4550	0.8818	0.9391
No log	2.5769	134	0.8512	0.4770	0.8512	0.9226
No log	2.6154	136	0.8666	0.4217	0.8666	0.9309
No log	2.6538	138	0.8111	0.4804	0.8111	0.9006
No log	2.6923	140	0.7704	0.5194	0.7704	0.8777
No log	2.7308	142	0.7717	0.4859	0.7717	0.8785
No log	2.7692	144	0.8072	0.5230	0.8072	0.8984
No log	2.8077	146	0.9168	0.4842	0.9168	0.9575
No log	2.8462	148	0.9635	0.4617	0.9635	0.9816
No log	2.8846	150	0.9223	0.4722	0.9223	0.9604
No log	2.9231	152	0.9472	0.4894	0.9472	0.9733
No log	2.9615	154	1.1430	0.4394	1.1430	1.0691
No log	3.0	156	1.5623	0.3145	1.5623	1.2499
No log	3.0385	158	1.6368	0.3129	1.6368	1.2794
No log	3.0769	160	1.3379	0.3366	1.3379	1.1567
No log	3.1154	162	0.9773	0.4534	0.9773	0.9886
No log	3.1538	164	0.8182	0.4918	0.8182	0.9046
No log	3.1923	166	0.7708	0.4946	0.7708	0.8780
No log	3.2308	168	0.7807	0.4984	0.7807	0.8836
No log	3.2692	170	0.9629	0.4215	0.9629	0.9813
No log	3.3077	172	1.2950	0.3717	1.2950	1.1380
No log	3.3462	174	1.3334	0.3274	1.3334	1.1547
No log	3.3846	176	1.0691	0.3935	1.0691	1.0340
No log	3.4231	178	0.7471	0.5078	0.7471	0.8643
No log	3.4615	180	0.6612	0.5088	0.6612	0.8131
No log	3.5	182	0.6541	0.5088	0.6541	0.8088
No log	3.5385	184	0.6883	0.5146	0.6883	0.8297
No log	3.5769	186	0.7637	0.4817	0.7637	0.8739
No log	3.6154	188	0.8275	0.4796	0.8275	0.9097
No log	3.6538	190	0.7820	0.5157	0.7820	0.8843
No log	3.6923	192	0.7678	0.4905	0.7678	0.8763
No log	3.7308	194	0.8062	0.4967	0.8062	0.8979
No log	3.7692	196	0.8705	0.5059	0.8705	0.9330
No log	3.8077	198	0.9335	0.4823	0.9335	0.9662
No log	3.8462	200	1.0731	0.4190	1.0731	1.0359
No log	3.8846	202	1.1728	0.4040	1.1728	1.0829
No log	3.9231	204	1.0514	0.4218	1.0514	1.0254
No log	3.9615	206	0.8802	0.4977	0.8802	0.9382
No log	4.0	208	0.8229	0.5510	0.8229	0.9072
No log	4.0385	210	0.7902	0.5667	0.7902	0.8889
No log	4.0769	212	0.7799	0.4869	0.7799	0.8831
No log	4.1154	214	0.8432	0.4761	0.8432	0.9183
No log	4.1538	216	0.9036	0.4663	0.9036	0.9506
No log	4.1923	218	0.9342	0.4675	0.9342	0.9666
No log	4.2308	220	0.8331	0.4584	0.8331	0.9128
No log	4.2692	222	0.7795	0.5230	0.7795	0.8829
No log	4.3077	224	0.7460	0.5589	0.7460	0.8637
No log	4.3462	226	0.7579	0.5408	0.7579	0.8706
No log	4.3846	228	0.7685	0.5589	0.7685	0.8767
No log	4.4231	230	0.8184	0.5353	0.8184	0.9047
No log	4.4615	232	0.9009	0.4521	0.9009	0.9492
No log	4.5	234	0.9424	0.4580	0.9424	0.9708
No log	4.5385	236	0.9110	0.4571	0.9110	0.9545
No log	4.5769	238	0.8157	0.5020	0.8157	0.9031
No log	4.6154	240	0.8062	0.5358	0.8062	0.8979
No log	4.6538	242	0.8014	0.5301	0.8014	0.8952
No log	4.6923	244	0.8137	0.5464	0.8137	0.9021
No log	4.7308	246	0.8649	0.4671	0.8649	0.9300
No log	4.7692	248	0.9055	0.4717	0.9055	0.9516
No log	4.8077	250	0.9994	0.4427	0.9994	0.9997
No log	4.8462	252	0.9741	0.4247	0.9741	0.9869
No log	4.8846	254	0.8963	0.4634	0.8963	0.9467
No log	4.9231	256	0.8310	0.5290	0.8310	0.9116
No log	4.9615	258	0.8162	0.5258	0.8162	0.9034
No log	5.0	260	0.8047	0.5002	0.8047	0.8971
No log	5.0385	262	0.7799	0.5105	0.7799	0.8831
No log	5.0769	264	0.7549	0.5003	0.7549	0.8689
No log	5.1154	266	0.7705	0.4917	0.7705	0.8778
No log	5.1538	268	0.7595	0.4969	0.7595	0.8715
No log	5.1923	270	0.7672	0.4865	0.7672	0.8759
No log	5.2308	272	0.8088	0.5031	0.8088	0.8993
No log	5.2692	274	0.7872	0.4917	0.7872	0.8873
No log	5.3077	276	0.7812	0.4969	0.7812	0.8839
No log	5.3462	278	0.7843	0.5071	0.7843	0.8856
No log	5.3846	280	0.8386	0.4992	0.8386	0.9157
No log	5.4231	282	0.9507	0.4324	0.9507	0.9750
No log	5.4615	284	0.9613	0.4500	0.9613	0.9805
No log	5.5	286	0.8666	0.4241	0.8666	0.9309
No log	5.5385	288	0.7594	0.5058	0.7594	0.8715
No log	5.5769	290	0.7165	0.4986	0.7165	0.8464
No log	5.6154	292	0.7090	0.4898	0.7090	0.8420
No log	5.6538	294	0.7559	0.4834	0.7559	0.8694
No log	5.6923	296	0.7904	0.4686	0.7904	0.8890
No log	5.7308	298	0.7627	0.4657	0.7627	0.8733
No log	5.7692	300	0.7484	0.4964	0.7484	0.8651
No log	5.8077	302	0.7714	0.4973	0.7714	0.8783
No log	5.8462	304	0.8145	0.4862	0.8145	0.9025
No log	5.8846	306	0.8627	0.4746	0.8627	0.9288
No log	5.9231	308	0.9412	0.4584	0.9412	0.9702
No log	5.9615	310	0.9535	0.4537	0.9535	0.9765
No log	6.0	312	0.9635	0.4045	0.9635	0.9816
No log	6.0385	314	0.9166	0.4571	0.9166	0.9574
No log	6.0769	316	0.8558	0.4933	0.8558	0.9251
No log	6.1154	318	0.8110	0.4950	0.8110	0.9006
No log	6.1538	320	0.7943	0.5056	0.7943	0.8912
No log	6.1923	322	0.7965	0.4937	0.7965	0.8925
No log	6.2308	324	0.8201	0.5056	0.8201	0.9056
No log	6.2692	326	0.8705	0.4947	0.8705	0.9330
No log	6.3077	328	0.9001	0.4933	0.9001	0.9487
No log	6.3462	330	0.9034	0.4926	0.9034	0.9505
No log	6.3846	332	0.9217	0.4680	0.9217	0.9600
No log	6.4231	334	0.9288	0.4725	0.9288	0.9637
No log	6.4615	336	0.9253	0.4714	0.9253	0.9619
No log	6.5	338	0.8920	0.4804	0.8920	0.9445
No log	6.5385	340	0.8391	0.4671	0.8391	0.9160
No log	6.5769	342	0.8086	0.4813	0.8086	0.8992
No log	6.6154	344	0.7608	0.5150	0.7608	0.8722
No log	6.6538	346	0.7443	0.5084	0.7443	0.8627
No log	6.6923	348	0.7506	0.4982	0.7506	0.8664
No log	6.7308	350	0.7942	0.4831	0.7942	0.8912
No log	6.7692	352	0.8683	0.4707	0.8683	0.9318
No log	6.8077	354	0.8961	0.4707	0.8961	0.9466
No log	6.8462	356	0.8642	0.4736	0.8642	0.9296
No log	6.8846	358	0.8322	0.4759	0.8322	0.9122
No log	6.9231	360	0.7794	0.4901	0.7794	0.8828
No log	6.9615	362	0.7470	0.5177	0.7470	0.8643
No log	7.0	364	0.7407	0.5291	0.7407	0.8606
No log	7.0385	366	0.7516	0.5164	0.7516	0.8670
No log	7.0769	368	0.7590	0.5199	0.7590	0.8712
No log	7.1154	370	0.7843	0.4804	0.7843	0.8856
No log	7.1538	372	0.8653	0.4735	0.8653	0.9302
No log	7.1923	374	0.9318	0.4900	0.9318	0.9653
No log	7.2308	376	0.9478	0.4900	0.9478	0.9735
No log	7.2692	378	0.9154	0.4740	0.9154	0.9567
No log	7.3077	380	0.8643	0.4863	0.8643	0.9297
No log	7.3462	382	0.8501	0.4905	0.8501	0.9220
No log	7.3846	384	0.8450	0.5002	0.8450	0.9192
No log	7.4231	386	0.8395	0.5002	0.8395	0.9162
No log	7.4615	388	0.8310	0.4968	0.8310	0.9116
No log	7.5	390	0.8349	0.4878	0.8349	0.9137
No log	7.5385	392	0.8489	0.4828	0.8489	0.9214
No log	7.5769	394	0.8456	0.4828	0.8456	0.9196
No log	7.6154	396	0.8515	0.4828	0.8515	0.9228
No log	7.6538	398	0.8398	0.4852	0.8398	0.9164
No log	7.6923	400	0.8318	0.4990	0.8318	0.9121
No log	7.7308	402	0.8268	0.4926	0.8268	0.9093
No log	7.7692	404	0.8195	0.4933	0.8195	0.9053
No log	7.8077	406	0.8156	0.4852	0.8156	0.9031
No log	7.8462	408	0.7981	0.4831	0.7981	0.8934
No log	7.8846	410	0.7928	0.4792	0.7928	0.8904
No log	7.9231	412	0.7993	0.4859	0.7993	0.8940
No log	7.9615	414	0.8125	0.5122	0.8125	0.9014
No log	8.0	416	0.8212	0.5122	0.8212	0.9062
No log	8.0385	418	0.8189	0.4792	0.8189	0.9049
No log	8.0769	420	0.8202	0.4947	0.8202	0.9056
No log	8.1154	422	0.8141	0.4933	0.8141	0.9023
No log	8.1538	424	0.8058	0.5025	0.8058	0.8977
No log	8.1923	426	0.8060	0.5032	0.8060	0.8978
No log	8.2308	428	0.8144	0.494	0.8144	0.9024
No log	8.2692	430	0.8256	0.4947	0.8256	0.9086
No log	8.3077	432	0.8382	0.4673	0.8382	0.9155
No log	8.3462	434	0.8383	0.5028	0.8383	0.9156
No log	8.3846	436	0.8303	0.5028	0.8303	0.9112
No log	8.4231	438	0.8364	0.4871	0.8364	0.9146
No log	8.4615	440	0.8507	0.4795	0.8507	0.9223
No log	8.5	442	0.8614	0.4532	0.8614	0.9281
No log	8.5385	444	0.8559	0.4480	0.8559	0.9251
No log	8.5769	446	0.8395	0.4851	0.8395	0.9163
No log	8.6154	448	0.8122	0.5	0.8122	0.9012
No log	8.6538	450	0.7924	0.5203	0.7924	0.8902
No log	8.6923	452	0.7806	0.5056	0.7806	0.8835
No log	8.7308	454	0.7739	0.5169	0.7739	0.8797
No log	8.7692	456	0.7742	0.5318	0.7742	0.8799
No log	8.8077	458	0.7794	0.5169	0.7794	0.8828
No log	8.8462	460	0.7885	0.5056	0.7885	0.8879
No log	8.8846	462	0.7904	0.5056	0.7904	0.8891
No log	8.9231	464	0.7996	0.5056	0.7996	0.8942
No log	8.9615	466	0.8090	0.5036	0.8090	0.8994
No log	9.0	468	0.8195	0.5171	0.8195	0.9053
No log	9.0385	470	0.8206	0.5171	0.8206	0.9059
No log	9.0769	472	0.8226	0.5044	0.8226	0.9069
No log	9.1154	474	0.8278	0.5152	0.8278	0.9098
No log	9.1538	476	0.8393	0.5074	0.8393	0.9161
No log	9.1923	478	0.8520	0.4759	0.8520	0.9230
No log	9.2308	480	0.8572	0.4865	0.8572	0.9258
No log	9.2692	482	0.8543	0.4973	0.8543	0.9243
No log	9.3077	484	0.8582	0.4959	0.8582	0.9264
No log	9.3462	486	0.8658	0.4852	0.8658	0.9305
No log	9.3846	488	0.8736	0.4973	0.8736	0.9347
No log	9.4231	490	0.8730	0.4852	0.8730	0.9344
No log	9.4615	492	0.8669	0.4959	0.8669	0.9311
No log	9.5	494	0.8626	0.4959	0.8626	0.9288
No log	9.5385	496	0.8592	0.4959	0.8592	0.9269
No log	9.5769	498	0.8547	0.4895	0.8547	0.9245
0.4489	9.6154	500	0.8489	0.4895	0.8489	0.9214
0.4489	9.6538	502	0.8400	0.4992	0.8400	0.9165
0.4489	9.6923	504	0.8311	0.5194	0.8311	0.9116
0.4489	9.7308	506	0.8254	0.5194	0.8254	0.9085
0.4489	9.7692	508	0.8200	0.4955	0.8200	0.9055
0.4489	9.8077	510	0.8167	0.4955	0.8167	0.9037
0.4489	9.8462	512	0.8143	0.4955	0.8143	0.9024
0.4489	9.8846	514	0.8133	0.4955	0.8133	0.9018
0.4489	9.9231	516	0.8122	0.4955	0.8122	0.9012
0.4489	9.9615	518	0.8117	0.4955	0.8117	0.9009
0.4489	10.0	520	0.8116	0.4955	0.8116	0.9009

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1