ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k11_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.4793
• Qwk: 0.5655
• Mse: 0.4793
• Rmse: 0.6923

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0690	2	2.4713	-0.0262	2.4713	1.5720
No log	0.1379	4	1.3112	0.0998	1.3112	1.1451
No log	0.2069	6	0.8126	0.0535	0.8126	0.9014
No log	0.2759	8	0.9384	0.0927	0.9384	0.9687
No log	0.3448	10	0.9361	0.2939	0.9361	0.9675
No log	0.4138	12	0.9504	0.2601	0.9504	0.9749
No log	0.4828	14	0.8084	0.2285	0.8084	0.8991
No log	0.5517	16	0.7364	-0.0027	0.7364	0.8582
No log	0.6207	18	0.7324	0.0898	0.7324	0.8558
No log	0.6897	20	0.7246	0.2494	0.7246	0.8513
No log	0.7586	22	0.6418	0.1277	0.6418	0.8011
No log	0.8276	24	0.6349	0.1604	0.6349	0.7968
No log	0.8966	26	0.6258	0.2002	0.6258	0.7911
No log	0.9655	28	0.6073	0.2783	0.6073	0.7793
No log	1.0345	30	0.6091	0.3426	0.6091	0.7804
No log	1.1034	32	0.5988	0.3377	0.5988	0.7738
No log	1.1724	34	0.7307	0.2886	0.7307	0.8548
No log	1.2414	36	0.8047	0.3094	0.8047	0.8971
No log	1.3103	38	0.7673	0.2817	0.7673	0.8760
No log	1.3793	40	0.6644	0.3999	0.6644	0.8151
No log	1.4483	42	0.5600	0.5361	0.5600	0.7483
No log	1.5172	44	0.6354	0.1935	0.6354	0.7971
No log	1.5862	46	0.8653	0.0717	0.8653	0.9302
No log	1.6552	48	0.8344	0.1268	0.8344	0.9135
No log	1.7241	50	0.6253	0.2995	0.6253	0.7907
No log	1.7931	52	0.5519	0.4938	0.5519	0.7429
No log	1.8621	54	0.6969	0.4280	0.6969	0.8348
No log	1.9310	56	0.9319	0.2009	0.9319	0.9653
No log	2.0	58	0.7648	0.3484	0.7648	0.8745
No log	2.0690	60	0.5696	0.4229	0.5696	0.7547
No log	2.1379	62	0.7540	0.3606	0.7540	0.8683
No log	2.2069	64	0.7939	0.3473	0.7939	0.8910
No log	2.2759	66	0.6664	0.2027	0.6664	0.8164
No log	2.3448	68	0.6484	0.2892	0.6484	0.8052
No log	2.4138	70	0.6587	0.2892	0.6587	0.8116
No log	2.4828	72	0.6601	0.2374	0.6601	0.8125
No log	2.5517	74	0.6708	0.2506	0.6708	0.8190
No log	2.6207	76	0.7576	0.2692	0.7576	0.8704
No log	2.6897	78	0.8451	0.3042	0.8451	0.9193
No log	2.7586	80	0.7793	0.3302	0.7793	0.8828
No log	2.8276	82	0.7341	0.2995	0.7341	0.8568
No log	2.8966	84	0.6643	0.3947	0.6643	0.8151
No log	2.9655	86	0.6658	0.4448	0.6658	0.8160
No log	3.0345	88	0.6494	0.4019	0.6494	0.8058
No log	3.1034	90	0.7082	0.4134	0.7082	0.8416
No log	3.1724	92	0.6082	0.5345	0.6082	0.7799
No log	3.2414	94	0.5783	0.4898	0.5783	0.7605
No log	3.3103	96	0.6344	0.4698	0.6344	0.7965
No log	3.3793	98	0.5719	0.4494	0.5719	0.7562
No log	3.4483	100	0.6078	0.4905	0.6078	0.7796
No log	3.5172	102	0.7656	0.4462	0.7656	0.8750
No log	3.5862	104	0.7331	0.4462	0.7331	0.8562
No log	3.6552	106	0.5704	0.5067	0.5704	0.7552
No log	3.7241	108	0.5438	0.4918	0.5438	0.7375
No log	3.7931	110	0.6863	0.5146	0.6863	0.8284
No log	3.8621	112	0.7505	0.4784	0.7505	0.8663
No log	3.9310	114	0.6640	0.5704	0.6640	0.8149
No log	4.0	116	0.6146	0.5285	0.6146	0.7840
No log	4.0690	118	0.5934	0.5397	0.5934	0.7703
No log	4.1379	120	0.5864	0.5646	0.5864	0.7658
No log	4.2069	122	0.5621	0.4696	0.5621	0.7498
No log	4.2759	124	0.5438	0.5617	0.5438	0.7374
No log	4.3448	126	0.5358	0.5184	0.5358	0.7320
No log	4.4138	128	0.5188	0.4478	0.5188	0.7203
No log	4.4828	130	0.5471	0.5587	0.5471	0.7396
No log	4.5517	132	0.5154	0.4762	0.5154	0.7179
No log	4.6207	134	0.5187	0.4828	0.5187	0.7202
No log	4.6897	136	0.5291	0.4828	0.5291	0.7274
No log	4.7586	138	0.5443	0.5157	0.5443	0.7378
No log	4.8276	140	0.5834	0.5195	0.5834	0.7638
No log	4.8966	142	0.5493	0.5157	0.5493	0.7411
No log	4.9655	144	0.5286	0.5184	0.5286	0.7271
No log	5.0345	146	0.5225	0.5413	0.5225	0.7228
No log	5.1034	148	0.5280	0.4596	0.5280	0.7266
No log	5.1724	150	0.5247	0.5798	0.5247	0.7244
No log	5.2414	152	0.5274	0.5714	0.5274	0.7263
No log	5.3103	154	0.5339	0.5475	0.5339	0.7307
No log	5.3793	156	0.5509	0.4147	0.5509	0.7422
No log	5.4483	158	0.6431	0.4243	0.6431	0.8020
No log	5.5172	160	0.6571	0.4243	0.6571	0.8106
No log	5.5862	162	0.5685	0.4379	0.5685	0.7540
No log	5.6552	164	0.5738	0.5286	0.5738	0.7575
No log	5.7241	166	0.5868	0.5697	0.5868	0.7660
No log	5.7931	168	0.6036	0.5190	0.6036	0.7769
No log	5.8621	170	0.6294	0.5220	0.6294	0.7934
No log	5.9310	172	0.6039	0.5220	0.6039	0.7771
No log	6.0	174	0.5347	0.5596	0.5347	0.7312
No log	6.0690	176	0.5286	0.5413	0.5286	0.7271
No log	6.1379	178	0.5218	0.5672	0.5218	0.7224
No log	6.2069	180	0.5373	0.4992	0.5373	0.7330
No log	6.2759	182	0.5949	0.5244	0.5949	0.7713
No log	6.3448	184	0.5970	0.5225	0.5970	0.7726
No log	6.4138	186	0.6047	0.5483	0.6047	0.7776
No log	6.4828	188	0.5960	0.5855	0.5960	0.7720
No log	6.5517	190	0.5577	0.5143	0.5577	0.7468
No log	6.6207	192	0.7070	0.3973	0.7070	0.8409
No log	6.6897	194	1.0776	0.3455	1.0776	1.0381
No log	6.7586	196	1.1114	0.2601	1.1114	1.0542
No log	6.8276	198	0.8878	0.3269	0.8878	0.9422
No log	6.8966	200	0.6498	0.3399	0.6498	0.8061
No log	6.9655	202	0.5950	0.4345	0.5950	0.7714
No log	7.0345	204	0.6231	0.4821	0.6231	0.7894
No log	7.1034	206	0.5820	0.4590	0.5820	0.7629
No log	7.1724	208	0.6002	0.3665	0.6002	0.7747
No log	7.2414	210	0.6328	0.3936	0.6328	0.7955
No log	7.3103	212	0.6459	0.4464	0.6459	0.8037
No log	7.3793	214	0.5910	0.3936	0.5910	0.7688
No log	7.4483	216	0.5352	0.4591	0.5352	0.7316
No log	7.5172	218	0.5457	0.4821	0.5457	0.7387
No log	7.5862	220	0.5635	0.5065	0.5635	0.7507
No log	7.6552	222	0.5198	0.5571	0.5198	0.7210
No log	7.7241	224	0.5076	0.5596	0.5076	0.7124
No log	7.7931	226	0.5052	0.5953	0.5052	0.7108
No log	7.8621	228	0.5173	0.5796	0.5173	0.7192
No log	7.9310	230	0.5132	0.5796	0.5132	0.7164
No log	8.0	232	0.4931	0.5796	0.4931	0.7022
No log	8.0690	234	0.4854	0.5985	0.4854	0.6967
No log	8.1379	236	0.4885	0.5826	0.4885	0.6990
No log	8.2069	238	0.4997	0.6465	0.4997	0.7069
No log	8.2759	240	0.5178	0.6361	0.5178	0.7196
No log	8.3448	242	0.5081	0.6130	0.5081	0.7128
No log	8.4138	244	0.4956	0.6020	0.4956	0.7040
No log	8.4828	246	0.5017	0.5283	0.5017	0.7083
No log	8.5517	248	0.4881	0.5356	0.4881	0.6987
No log	8.6207	250	0.4807	0.5556	0.4807	0.6933
No log	8.6897	252	0.4888	0.5521	0.4888	0.6992
No log	8.7586	254	0.5034	0.5819	0.5034	0.7095
No log	8.8276	256	0.4881	0.5267	0.4881	0.6986
No log	8.8966	258	0.4864	0.5493	0.4864	0.6974
No log	8.9655	260	0.4879	0.5265	0.4879	0.6985
No log	9.0345	262	0.4947	0.5432	0.4947	0.7033
No log	9.1034	264	0.4905	0.5672	0.4905	0.7004
No log	9.1724	266	0.5034	0.5662	0.5034	0.7095
No log	9.2414	268	0.5264	0.5708	0.5264	0.7255
No log	9.3103	270	0.5500	0.5166	0.5500	0.7416
No log	9.3793	272	0.5245	0.5034	0.5245	0.7242
No log	9.4483	274	0.5261	0.5104	0.5261	0.7254
No log	9.5172	276	0.5107	0.5345	0.5107	0.7146
No log	9.5862	278	0.4834	0.6648	0.4834	0.6953
No log	9.6552	280	0.4848	0.6154	0.4848	0.6963
No log	9.7241	282	0.4817	0.6154	0.4817	0.6940
No log	9.7931	284	0.4935	0.5877	0.4935	0.7025
No log	9.8621	286	0.5096	0.5512	0.5096	0.7138
No log	9.9310	288	0.5478	0.5095	0.5478	0.7402
No log	10.0	290	0.5147	0.5438	0.5147	0.7174
No log	10.0690	292	0.4984	0.5796	0.4984	0.7059
No log	10.1379	294	0.4999	0.5877	0.4999	0.7070
No log	10.2069	296	0.4949	0.5731	0.4949	0.7035
No log	10.2759	298	0.4925	0.5815	0.4925	0.7018
No log	10.3448	300	0.4864	0.5591	0.4864	0.6974
No log	10.4138	302	0.4799	0.5324	0.4799	0.6927
No log	10.4828	304	0.4788	0.5798	0.4788	0.6920
No log	10.5517	306	0.4940	0.5897	0.4940	0.7028
No log	10.6207	308	0.4745	0.5565	0.4745	0.6888
No log	10.6897	310	0.4772	0.6082	0.4772	0.6908
No log	10.7586	312	0.4669	0.6154	0.4669	0.6833
No log	10.8276	314	0.4940	0.4945	0.4940	0.7029
No log	10.8966	316	0.5273	0.4835	0.5273	0.7261
No log	10.9655	318	0.5190	0.4911	0.5190	0.7204
No log	11.0345	320	0.4596	0.5517	0.4596	0.6779
No log	11.1034	322	0.4441	0.6267	0.4441	0.6664
No log	11.1724	324	0.5032	0.6248	0.5032	0.7094
No log	11.2414	326	0.5040	0.6061	0.5040	0.7099
No log	11.3103	328	0.4472	0.6105	0.4472	0.6688
No log	11.3793	330	0.4915	0.5327	0.4915	0.7011
No log	11.4483	332	0.5744	0.4808	0.5744	0.7579
No log	11.5172	334	0.6056	0.4726	0.6056	0.7782
No log	11.5862	336	0.5250	0.4597	0.5250	0.7246
No log	11.6552	338	0.4515	0.6060	0.4515	0.6719
No log	11.7241	340	0.4592	0.6032	0.4592	0.6777
No log	11.7931	342	0.4497	0.6556	0.4497	0.6706
No log	11.8621	344	0.4482	0.5715	0.4482	0.6695
No log	11.9310	346	0.4695	0.5017	0.4695	0.6852
No log	12.0	348	0.4455	0.5437	0.4455	0.6674
No log	12.0690	350	0.4312	0.6170	0.4312	0.6567
No log	12.1379	352	0.4555	0.6210	0.4555	0.6749
No log	12.2069	354	0.4525	0.6210	0.4525	0.6727
No log	12.2759	356	0.4318	0.5956	0.4318	0.6571
No log	12.3448	358	0.4787	0.5481	0.4787	0.6918
No log	12.4138	360	0.5603	0.5131	0.5603	0.7485
No log	12.4828	362	0.5770	0.4892	0.5770	0.7596
No log	12.5517	364	0.5194	0.5527	0.5194	0.7207
No log	12.6207	366	0.4618	0.5017	0.4618	0.6796
No log	12.6897	368	0.4529	0.4795	0.4529	0.6729
No log	12.7586	370	0.4611	0.4705	0.4611	0.6791
No log	12.8276	372	0.4948	0.5527	0.4948	0.7035
No log	12.8966	374	0.5659	0.5190	0.5659	0.7523
No log	12.9655	376	0.5989	0.4870	0.5989	0.7739
No log	13.0345	378	0.5306	0.5190	0.5306	0.7284
No log	13.1034	380	0.4674	0.4945	0.4674	0.6837
No log	13.1724	382	0.4540	0.6417	0.4540	0.6738
No log	13.2414	384	0.4699	0.5324	0.4699	0.6855
No log	13.3103	386	0.4659	0.5324	0.4659	0.6826
No log	13.3793	388	0.4586	0.6184	0.4586	0.6772
No log	13.4483	390	0.4623	0.5671	0.4623	0.6799
No log	13.5172	392	0.4593	0.5708	0.4593	0.6777
No log	13.5862	394	0.4494	0.5734	0.4494	0.6704
No log	13.6552	396	0.4767	0.6210	0.4767	0.6904
No log	13.7241	398	0.5518	0.5513	0.5518	0.7428
No log	13.7931	400	0.5360	0.5368	0.5360	0.7321
No log	13.8621	402	0.4885	0.6082	0.4885	0.6990
No log	13.9310	404	0.4674	0.6462	0.4674	0.6836
No log	14.0	406	0.4715	0.6462	0.4715	0.6866
No log	14.0690	408	0.4674	0.6462	0.4674	0.6837
No log	14.1379	410	0.4568	0.5869	0.4568	0.6759
No log	14.2069	412	0.4624	0.5475	0.4624	0.6800
No log	14.2759	414	0.4558	0.5869	0.4558	0.6751
No log	14.3448	416	0.4549	0.5305	0.4549	0.6744
No log	14.4138	418	0.4533	0.4878	0.4533	0.6732
No log	14.4828	420	0.4587	0.4809	0.4587	0.6773
No log	14.5517	422	0.4706	0.5475	0.4706	0.6860
No log	14.6207	424	0.4782	0.5432	0.4782	0.6915
No log	14.6897	426	0.4806	0.5189	0.4806	0.6933
No log	14.7586	428	0.4663	0.5930	0.4663	0.6829
No log	14.8276	430	0.4600	0.5533	0.4600	0.6782
No log	14.8966	432	0.4991	0.5034	0.4991	0.7064
No log	14.9655	434	0.5663	0.4491	0.5663	0.7526
No log	15.0345	436	0.5382	0.4330	0.5382	0.7336
No log	15.1034	438	0.4876	0.5386	0.4876	0.6983
No log	15.1724	440	0.4780	0.4471	0.4780	0.6914
No log	15.2414	442	0.4727	0.5079	0.4727	0.6875
No log	15.3103	444	0.4624	0.5268	0.4624	0.6800
No log	15.3793	446	0.4763	0.5195	0.4763	0.6901
No log	15.4483	448	0.5037	0.5086	0.5037	0.7097
No log	15.5172	450	0.4763	0.5195	0.4763	0.6901
No log	15.5862	452	0.4445	0.5912	0.4445	0.6667
No log	15.6552	454	0.4436	0.6073	0.4436	0.6660
No log	15.7241	456	0.4645	0.5611	0.4645	0.6816
No log	15.7931	458	0.4596	0.5463	0.4596	0.6780
No log	15.8621	460	0.4520	0.6073	0.4520	0.6723
No log	15.9310	462	0.4731	0.5533	0.4731	0.6878
No log	16.0	464	0.4958	0.5512	0.4958	0.7041
No log	16.0690	466	0.4953	0.5498	0.4953	0.7038
No log	16.1379	468	0.4762	0.5195	0.4762	0.6900
No log	16.2069	470	0.4555	0.5648	0.4555	0.6749
No log	16.2759	472	0.4517	0.6125	0.4517	0.6721
No log	16.3448	474	0.4473	0.6039	0.4473	0.6688
No log	16.4138	476	0.4431	0.6125	0.4431	0.6657
No log	16.4828	478	0.4445	0.5631	0.4445	0.6667
No log	16.5517	480	0.4507	0.5289	0.4507	0.6713
No log	16.6207	482	0.4596	0.5195	0.4596	0.6780
No log	16.6897	484	0.4448	0.5307	0.4448	0.6670
No log	16.7586	486	0.4485	0.6335	0.4485	0.6697
No log	16.8276	488	0.4588	0.5869	0.4588	0.6773
No log	16.8966	490	0.4682	0.5348	0.4682	0.6842
No log	16.9655	492	0.4934	0.5017	0.4934	0.7024
No log	17.0345	494	0.4908	0.5498	0.4908	0.7006
No log	17.1034	496	0.4784	0.5345	0.4784	0.6917
No log	17.1724	498	0.4613	0.5951	0.4613	0.6792
0.3453	17.2414	500	0.4504	0.6184	0.4504	0.6711
0.3453	17.3103	502	0.4635	0.5943	0.4635	0.6808
0.3453	17.3793	504	0.4644	0.5943	0.4644	0.6814
0.3453	17.4483	506	0.4586	0.5812	0.4586	0.6772
0.3453	17.5172	508	0.4484	0.5846	0.4484	0.6696
0.3453	17.5862	510	0.4793	0.5655	0.4793	0.6923

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1