Arabic_FineTuningAraBERT_AugV4_k2_task5_organization_fold1

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9822
• Qwk: 0.5782
• Mse: 0.9822
• Rmse: 0.9911

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0606	2	2.1222	0.0	2.1222	1.4568
No log	0.1212	4	1.3195	-0.0492	1.3195	1.1487
No log	0.1818	6	1.3135	0.1541	1.3135	1.1461
No log	0.2424	8	1.7614	0.1688	1.7614	1.3272
No log	0.3030	10	1.1534	0.3094	1.1534	1.0740
No log	0.3636	12	1.6878	0.3348	1.6878	1.2991
No log	0.4242	14	1.0201	0.3351	1.0201	1.0100
No log	0.4848	16	1.8935	0.3459	1.8935	1.3761
No log	0.5455	18	2.8767	0.2588	2.8767	1.6961
No log	0.6061	20	2.4546	0.2066	2.4546	1.5667
No log	0.6667	22	1.1595	0.5662	1.1595	1.0768
No log	0.7273	24	0.7424	0.3931	0.7424	0.8617
No log	0.7879	26	0.7724	0.4638	0.7724	0.8788
No log	0.8485	28	0.9146	0.4070	0.9146	0.9563
No log	0.9091	30	0.9017	0.3979	0.9017	0.9496
No log	0.9697	32	0.9732	0.4647	0.9732	0.9865
No log	1.0303	34	0.8432	0.5270	0.8432	0.9183
No log	1.0909	36	0.7949	0.5796	0.7949	0.8916
No log	1.1515	38	0.9772	0.5316	0.9772	0.9885
No log	1.2121	40	0.8554	0.5506	0.8554	0.9249
No log	1.2727	42	1.0168	0.4622	1.0168	1.0083
No log	1.3333	44	1.6285	0.4420	1.6285	1.2761
No log	1.3939	46	1.8188	0.3687	1.8188	1.3486
No log	1.4545	48	1.5095	0.3810	1.5095	1.2286
No log	1.5152	50	0.9389	0.5870	0.9389	0.9690
No log	1.5758	52	0.7641	0.7053	0.7641	0.8741
No log	1.6364	54	0.7772	0.7183	0.7772	0.8816
No log	1.6970	56	0.8596	0.7148	0.8596	0.9272
No log	1.7576	58	1.1941	0.4881	1.1941	1.0927
No log	1.8182	60	1.3234	0.4618	1.3234	1.1504
No log	1.8788	62	1.3715	0.4712	1.3715	1.1711
No log	1.9394	64	1.1537	0.5174	1.1537	1.0741
No log	2.0	66	1.0373	0.5092	1.0373	1.0185
No log	2.0606	68	0.8503	0.6767	0.8503	0.9221
No log	2.1212	70	0.8422	0.6767	0.8422	0.9177
No log	2.1818	72	0.9794	0.5208	0.9794	0.9897
No log	2.2424	74	0.9889	0.5285	0.9889	0.9944
No log	2.3030	76	0.8425	0.6767	0.8425	0.9179
No log	2.3636	78	0.6725	0.6768	0.6725	0.8201
No log	2.4242	80	0.6801	0.6768	0.6801	0.8247
No log	2.4848	82	0.8840	0.6468	0.8840	0.9402
No log	2.5455	84	1.3353	0.52	1.3353	1.1555
No log	2.6061	86	1.3168	0.5110	1.3168	1.1475
No log	2.6667	88	1.0167	0.5625	1.0167	1.0083
No log	2.7273	90	0.7150	0.6606	0.7150	0.8456
No log	2.7879	92	0.6512	0.6606	0.6512	0.8070
No log	2.8485	94	0.6887	0.6606	0.6887	0.8299
No log	2.9091	96	0.9792	0.5625	0.9792	0.9895
No log	2.9697	98	1.3640	0.5023	1.3640	1.1679
No log	3.0303	100	1.3528	0.5110	1.3528	1.1631
No log	3.0909	102	1.0429	0.4981	1.0429	1.0212
No log	3.1515	104	0.8173	0.6768	0.8173	0.9040
No log	3.2121	106	0.7519	0.6768	0.7519	0.8671
No log	3.2727	108	0.7631	0.6768	0.7631	0.8735
No log	3.3333	110	0.7489	0.6768	0.7489	0.8654
No log	3.3939	112	0.7492	0.6768	0.7492	0.8656
No log	3.4545	114	0.8581	0.6756	0.8581	0.9263
No log	3.5152	116	0.8307	0.6756	0.8307	0.9114
No log	3.5758	118	0.7908	0.7036	0.7908	0.8893
No log	3.6364	120	0.8068	0.6905	0.8068	0.8982
No log	3.6970	122	0.8911	0.6022	0.8911	0.9440
No log	3.7576	124	0.9685	0.6022	0.9685	0.9841
No log	3.8182	126	0.9235	0.5977	0.9235	0.9610
No log	3.8788	128	0.9199	0.5977	0.9199	0.9591
No log	3.9394	130	0.9822	0.5192	0.9822	0.9911
No log	4.0	132	1.1605	0.5414	1.1605	1.0773
No log	4.0606	134	1.1955	0.5134	1.1955	1.0934
No log	4.1212	136	1.1319	0.5414	1.1319	1.0639
No log	4.1818	138	1.0140	0.5463	1.0140	1.0070
No log	4.2424	140	0.9131	0.5977	0.9131	0.9556
No log	4.3030	142	0.9846	0.5463	0.9846	0.9922
No log	4.3636	144	0.9884	0.5463	0.9884	0.9942
No log	4.4242	146	0.9171	0.5800	0.9171	0.9577
No log	4.4848	148	0.9097	0.5463	0.9097	0.9538
No log	4.5455	150	0.9587	0.5463	0.9587	0.9791
No log	4.6061	152	1.0880	0.5414	1.0880	1.0431
No log	4.6667	154	1.1662	0.5414	1.1662	1.0799
No log	4.7273	156	1.2970	0.5041	1.2970	1.1389
No log	4.7879	158	1.2492	0.5134	1.2492	1.1177
No log	4.8485	160	1.0542	0.6034	1.0542	1.0268
No log	4.9091	162	0.8384	0.6022	0.8384	0.9157
No log	4.9697	164	0.7912	0.6914	0.7912	0.8895
No log	5.0303	166	0.8591	0.5992	0.8591	0.9269
No log	5.0909	168	1.0425	0.5704	1.0425	1.0210
No log	5.1515	170	1.0918	0.5645	1.0918	1.0449
No log	5.2121	172	0.9766	0.5704	0.9766	0.9882
No log	5.2727	174	0.9397	0.5704	0.9397	0.9694
No log	5.3333	176	0.9798	0.5704	0.9798	0.9898
No log	5.3939	178	1.0190	0.5704	1.0190	1.0094
No log	5.4545	180	0.9931	0.5704	0.9931	0.9966
No log	5.5152	182	1.0036	0.5370	1.0036	1.0018
No log	5.5758	184	1.0615	0.5878	1.0615	1.0303
No log	5.6364	186	1.2225	0.5470	1.2225	1.1057
No log	5.6970	188	1.2258	0.5470	1.2258	1.1072
No log	5.7576	190	1.0926	0.5782	1.0926	1.0453
No log	5.8182	192	0.8791	0.6374	0.8791	0.9376
No log	5.8788	194	0.7748	0.6768	0.7748	0.8802
No log	5.9394	196	0.7660	0.6914	0.7660	0.8752
No log	6.0	198	0.7826	0.6914	0.7826	0.8847
No log	6.0606	200	0.8593	0.6374	0.8593	0.9270
No log	6.1212	202	1.0372	0.5782	1.0372	1.0184
No log	6.1818	204	1.1392	0.5329	1.1392	1.0673
No log	6.2424	206	1.1363	0.5230	1.1363	1.0660
No log	6.3030	208	1.0337	0.5675	1.0337	1.0167
No log	6.3636	210	0.8789	0.6086	0.8789	0.9375
No log	6.4242	212	0.7666	0.6468	0.7666	0.8755
No log	6.4848	214	0.7311	0.6923	0.7311	0.8550
No log	6.5455	216	0.7544	0.6622	0.7544	0.8686
No log	6.6061	218	0.8494	0.6058	0.8494	0.9216
No log	6.6667	220	0.9539	0.5370	0.9539	0.9767
No log	6.7273	222	1.0997	0.5312	1.0997	1.0486
No log	6.7879	224	1.0916	0.5329	1.0916	1.0448
No log	6.8485	226	0.9767	0.5782	0.9767	0.9883
No log	6.9091	228	0.9000	0.5303	0.9000	0.9487
No log	6.9697	230	0.8287	0.6468	0.8287	0.9103
No log	7.0303	232	0.7888	0.6468	0.7888	0.8882
No log	7.0909	234	0.7748	0.6488	0.7748	0.8802
No log	7.1515	236	0.8174	0.6468	0.8174	0.9041
No log	7.2121	238	0.8681	0.6468	0.8681	0.9317
No log	7.2727	240	0.9382	0.5625	0.9382	0.9686
No log	7.3333	242	1.0010	0.5414	1.0010	1.0005
No log	7.3939	244	1.0115	0.4981	1.0115	1.0057
No log	7.4545	246	0.9626	0.4892	0.9626	0.9811
No log	7.5152	248	0.8957	0.6058	0.8957	0.9464
No log	7.5758	250	0.8396	0.6468	0.8396	0.9163
No log	7.6364	252	0.8448	0.6468	0.8448	0.9191
No log	7.6970	254	0.8862	0.6058	0.8862	0.9414
No log	7.7576	256	0.9459	0.5303	0.9459	0.9726
No log	7.8182	258	1.0366	0.5329	1.0366	1.0181
No log	7.8788	260	1.0615	0.5329	1.0615	1.0303
No log	7.9394	262	1.0392	0.5329	1.0392	1.0194
No log	8.0	264	1.0009	0.5782	1.0009	1.0004
No log	8.0606	266	0.9512	0.5782	0.9512	0.9753
No log	8.1212	268	0.8920	0.5303	0.8920	0.9445
No log	8.1818	270	0.8296	0.6488	0.8296	0.9108
No log	8.2424	272	0.8093	0.6768	0.8093	0.8996
No log	8.3030	274	0.8190	0.6768	0.8190	0.9050
No log	8.3636	276	0.8592	0.6488	0.8592	0.9269
No log	8.4242	278	0.9178	0.5695	0.9178	0.9580
No log	8.4848	280	0.9675	0.5329	0.9675	0.9836
No log	8.5455	282	1.0137	0.5329	1.0137	1.0068
No log	8.6061	284	1.0507	0.5329	1.0507	1.0251
No log	8.6667	286	1.0761	0.5312	1.0761	1.0373
No log	8.7273	288	1.0556	0.5329	1.0556	1.0274
No log	8.7879	290	1.0098	0.5329	1.0098	1.0049
No log	8.8485	292	0.9521	0.5370	0.9521	0.9757
No log	8.9091	294	0.9023	0.5756	0.9023	0.9499
No log	8.9697	296	0.8694	0.6488	0.8694	0.9324
No log	9.0303	298	0.8545	0.6488	0.8545	0.9244
No log	9.0909	300	0.8461	0.6488	0.8461	0.9198
No log	9.1515	302	0.8441	0.6488	0.8441	0.9188
No log	9.2121	304	0.8551	0.6488	0.8551	0.9247
No log	9.2727	306	0.8769	0.5712	0.8769	0.9365
No log	9.3333	308	0.9106	0.5695	0.9106	0.9542
No log	9.3939	310	0.9475	0.5370	0.9475	0.9734
No log	9.4545	312	0.9696	0.5782	0.9696	0.9847
No log	9.5152	314	0.9905	0.5782	0.9905	0.9952
No log	9.5758	316	0.9987	0.5782	0.9987	0.9993
No log	9.6364	318	1.0042	0.5782	1.0042	1.0021
No log	9.6970	320	1.0084	0.5329	1.0084	1.0042
No log	9.7576	322	1.0048	0.5329	1.0048	1.0024
No log	9.8182	324	0.9981	0.5782	0.9981	0.9991
No log	9.8788	326	0.9910	0.5782	0.9910	0.9955
No log	9.9394	328	0.9852	0.5782	0.9852	0.9926
No log	10.0	330	0.9822	0.5782	0.9822	0.9911

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1