Arabic_FineTuningAraBERT_AugV0_k10_task2_organization_fold1

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.4868
• Qwk: 0.4935
• Mse: 0.4868
• Rmse: 0.6977

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0377	2	3.9824	0.0335	3.9824	1.9956
No log	0.0755	4	1.7772	-0.0396	1.7772	1.3331
No log	0.1132	6	0.9944	0.3333	0.9944	0.9972
No log	0.1509	8	0.5455	0.25	0.5455	0.7386
No log	0.1887	10	0.7787	-0.2545	0.7787	0.8824
No log	0.2264	12	0.9635	-0.0645	0.9635	0.9816
No log	0.2642	14	0.8024	-0.1311	0.8024	0.8958
No log	0.3019	16	0.6876	-0.0364	0.6876	0.8292
No log	0.3396	18	0.5939	0.0816	0.5939	0.7706
No log	0.3774	20	0.5694	0.3265	0.5694	0.7546
No log	0.4151	22	0.5760	0.25	0.5760	0.7589
No log	0.4528	24	0.5933	0.0870	0.5933	0.7703
No log	0.4906	26	0.5907	0.25	0.5907	0.7685
No log	0.5283	28	0.5984	0.0377	0.5984	0.7736
No log	0.5660	30	0.6039	0.0357	0.6039	0.7771
No log	0.6038	32	0.6224	0.0339	0.6224	0.7889
No log	0.6415	34	0.5749	0.0727	0.5749	0.7582
No log	0.6792	36	0.5547	0.0	0.5547	0.7448
No log	0.7170	38	0.6407	0.0	0.6407	0.8004
No log	0.7547	40	0.6483	0.0	0.6483	0.8052
No log	0.7925	42	0.5986	0.0	0.5986	0.7737
No log	0.8302	44	0.5671	0.1702	0.5671	0.7530
No log	0.8679	46	0.5416	0.25	0.5416	0.7360
No log	0.9057	48	0.5065	0.0816	0.5065	0.7117
No log	0.9434	50	0.5006	0.1702	0.5006	0.7076
No log	0.9811	52	0.5025	0.1702	0.5025	0.7089
No log	1.0189	54	0.5191	0.1702	0.5191	0.7205
No log	1.0566	56	0.5048	0.2642	0.5048	0.7105
No log	1.0943	58	0.5031	0.1176	0.5031	0.7093
No log	1.1321	60	0.5503	0.2105	0.5503	0.7418
No log	1.1698	62	0.5415	0.1509	0.5415	0.7359
No log	1.2075	64	0.5913	0.2642	0.5913	0.7690
No log	1.2453	66	0.6632	0.3284	0.6632	0.8144
No log	1.2830	68	0.5395	0.1231	0.5395	0.7345
No log	1.3208	70	0.4664	0.4375	0.4664	0.6830
No log	1.3585	72	0.5477	0.4923	0.5477	0.7401
No log	1.3962	74	0.5890	0.4	0.5890	0.7675
No log	1.4340	76	0.5722	0.1429	0.5722	0.7564
No log	1.4717	78	0.6226	0.0	0.6226	0.7890
No log	1.5094	80	0.6722	0.1600	0.6722	0.8199
No log	1.5472	82	0.6444	-0.0385	0.6444	0.8028
No log	1.5849	84	0.6069	0.1429	0.6069	0.7790
No log	1.6226	86	0.5545	0.1429	0.5545	0.7446
No log	1.6604	88	0.5320	0.1429	0.5320	0.7294
No log	1.6981	90	0.5039	0.1429	0.5039	0.7099
No log	1.7358	92	0.5652	0.3226	0.5652	0.7518
No log	1.7736	94	0.5445	0.3077	0.5445	0.7379
No log	1.8113	96	0.4840	0.1111	0.4840	0.6957
No log	1.8491	98	0.4673	0.1509	0.4673	0.6836
No log	1.8868	100	0.4720	0.1176	0.4720	0.6870
No log	1.9245	102	0.4833	0.1111	0.4833	0.6952
No log	1.9623	104	0.4640	0.1429	0.4640	0.6812
No log	2.0	106	0.4695	0.2759	0.4695	0.6852
No log	2.0377	108	0.4854	0.2105	0.4854	0.6967
No log	2.0755	110	0.4879	0.3390	0.4879	0.6985
No log	2.1132	112	0.4956	0.3226	0.4956	0.7040
No log	2.1509	114	0.5102	0.2105	0.5102	0.7143
No log	2.1887	116	0.5105	0.2500	0.5105	0.7145
No log	2.2264	118	0.5035	0.1509	0.5035	0.7096
No log	2.2642	120	0.5111	0.0769	0.5111	0.7149
No log	2.3019	122	0.5207	0.2105	0.5207	0.7216
No log	2.3396	124	0.5754	0.2759	0.5754	0.7586
No log	2.3774	126	0.6099	0.2941	0.6099	0.7810
No log	2.4151	128	0.5604	0.3684	0.5604	0.7486
No log	2.4528	130	0.5271	0.2059	0.5271	0.7260
No log	2.4906	132	0.5213	0.2059	0.5213	0.7220
No log	2.5283	134	0.5314	0.3143	0.5314	0.7289
No log	2.5660	136	0.5588	0.4304	0.5588	0.7476
No log	2.6038	138	0.5604	0.4304	0.5604	0.7486
No log	2.6415	140	0.5114	0.3636	0.5114	0.7151
No log	2.6792	142	0.5066	0.3478	0.5066	0.7118
No log	2.7170	144	0.5189	0.3143	0.5189	0.7203
No log	2.7547	146	0.5298	0.4507	0.5298	0.7278
No log	2.7925	148	0.5242	0.3478	0.5242	0.7240
No log	2.8302	150	0.5051	0.3478	0.5051	0.7107
No log	2.8679	152	0.5139	0.3226	0.5139	0.7169
No log	2.9057	154	0.5343	0.2105	0.5343	0.7310
No log	2.9434	156	0.5991	0.4000	0.5991	0.7740
No log	2.9811	158	0.7421	0.4179	0.7421	0.8614
No log	3.0189	160	0.6790	0.4179	0.6790	0.8240
No log	3.0566	162	0.5263	0.475	0.5263	0.7255
No log	3.0943	164	0.5007	0.3846	0.5007	0.7076
No log	3.1321	166	0.4710	0.3377	0.4710	0.6863
No log	3.1698	168	0.4127	0.6154	0.4127	0.6424
No log	3.2075	170	0.4213	0.4923	0.4213	0.6491
No log	3.2453	172	0.4306	0.5588	0.4306	0.6562
No log	3.2830	174	0.4597	0.3143	0.4597	0.6780
No log	3.3208	176	0.4916	0.3478	0.4916	0.7012
No log	3.3585	178	0.5061	0.2388	0.5061	0.7114
No log	3.3962	180	0.5055	0.3143	0.5055	0.7110
No log	3.4340	182	0.5517	0.2154	0.5517	0.7428
No log	3.4717	184	0.5810	0.3284	0.5810	0.7623
No log	3.5094	186	0.5665	0.1724	0.5665	0.7527
No log	3.5472	188	0.5659	0.1600	0.5659	0.7522
No log	3.5849	190	0.5963	0.1702	0.5963	0.7722
No log	3.6226	192	0.6608	0.1923	0.6608	0.8129
No log	3.6604	194	0.6690	0.3284	0.6690	0.8179
No log	3.6981	196	0.5737	0.4375	0.5737	0.7574
No log	3.7358	198	0.4901	0.3143	0.4901	0.7001
No log	3.7736	200	0.5362	0.4	0.5362	0.7322
No log	3.8113	202	0.5238	0.4	0.5238	0.7237
No log	3.8491	204	0.4759	0.4923	0.4759	0.6898
No log	3.8868	206	0.4734	0.2388	0.4734	0.6880
No log	3.9245	208	0.5309	0.3824	0.5309	0.7286
No log	3.9623	210	0.5339	0.3284	0.5339	0.7307
No log	4.0	212	0.4702	0.3810	0.4702	0.6857
No log	4.0377	214	0.4324	0.4348	0.4324	0.6576
No log	4.0755	216	0.4422	0.5	0.4422	0.6650
No log	4.1132	218	0.4472	0.5217	0.4472	0.6688
No log	4.1509	220	0.4265	0.4507	0.4265	0.6531
No log	4.1887	222	0.4159	0.4	0.4159	0.6449
No log	4.2264	224	0.4094	0.4348	0.4094	0.6398
No log	4.2642	226	0.4200	0.4545	0.4200	0.6481
No log	4.3019	228	0.4701	0.3438	0.4701	0.6857
No log	4.3396	230	0.4955	0.3438	0.4955	0.7039
No log	4.3774	232	0.4670	0.4179	0.4670	0.6834
No log	4.4151	234	0.4571	0.3143	0.4571	0.6761
No log	4.4528	236	0.4794	0.4324	0.4794	0.6924
No log	4.4906	238	0.4769	0.4167	0.4769	0.6905
No log	4.5283	240	0.4632	0.4	0.4632	0.6806
No log	4.5660	242	0.4602	0.4348	0.4602	0.6784
No log	4.6038	244	0.4589	0.4348	0.4589	0.6774
No log	4.6415	246	0.4603	0.2817	0.4603	0.6785
No log	4.6792	248	0.4908	0.4179	0.4908	0.7006
No log	4.7170	250	0.5414	0.4878	0.5414	0.7358
No log	4.7547	252	0.5506	0.5227	0.5506	0.7421
No log	4.7925	254	0.5217	0.4419	0.5217	0.7223
No log	4.8302	256	0.5003	0.3143	0.5003	0.7074
No log	4.8679	258	0.4964	0.2941	0.4964	0.7045
No log	4.9057	260	0.5330	0.3836	0.5330	0.7301
No log	4.9434	262	0.5611	0.4156	0.5611	0.7490
No log	4.9811	264	0.5323	0.3836	0.5323	0.7296
No log	5.0189	266	0.4769	0.2388	0.4769	0.6905
No log	5.0566	268	0.4654	0.3478	0.4654	0.6822
No log	5.0943	270	0.4682	0.3478	0.4682	0.6842
No log	5.1321	272	0.4728	0.3514	0.4728	0.6876
No log	5.1698	274	0.4739	0.3014	0.4739	0.6884
No log	5.2075	276	0.4682	0.3014	0.4682	0.6843
No log	5.2453	278	0.4529	0.2609	0.4529	0.6730
No log	5.2830	280	0.4373	0.2609	0.4373	0.6613
No log	5.3208	282	0.4292	0.3636	0.4292	0.6551
No log	5.3585	284	0.4299	0.5161	0.4299	0.6557
No log	5.3962	286	0.4185	0.5075	0.4185	0.6469
No log	5.4340	288	0.4144	0.3478	0.4144	0.6438
No log	5.4717	290	0.4170	0.3284	0.4170	0.6458
No log	5.5094	292	0.4166	0.2857	0.4166	0.6455
No log	5.5472	294	0.4185	0.3390	0.4185	0.6469
No log	5.5849	296	0.4222	0.3390	0.4222	0.6497
No log	5.6226	298	0.4261	0.2759	0.4261	0.6527
No log	5.6604	300	0.4329	0.2222	0.4329	0.6579
No log	5.6981	302	0.4372	0.4	0.4372	0.6612
No log	5.7358	304	0.4389	0.3158	0.4389	0.6625
No log	5.7736	306	0.4375	0.2222	0.4375	0.6614
No log	5.8113	308	0.4440	0.3478	0.4440	0.6663
No log	5.8491	310	0.4533	0.3143	0.4533	0.6733
No log	5.8868	312	0.4696	0.48	0.4696	0.6852
No log	5.9245	314	0.4713	0.48	0.4713	0.6865
No log	5.9623	316	0.4611	0.4507	0.4611	0.6790
No log	6.0	318	0.4632	0.3824	0.4632	0.6806
No log	6.0377	320	0.4682	0.3284	0.4682	0.6842
No log	6.0755	322	0.4681	0.5075	0.4681	0.6842
No log	6.1132	324	0.4611	0.3143	0.4611	0.6791
No log	6.1509	326	0.4604	0.4167	0.4604	0.6785
No log	6.1887	328	0.4730	0.4706	0.4730	0.6878
No log	6.2264	330	0.4686	0.4706	0.4686	0.6845
No log	6.2642	332	0.4604	0.4706	0.4604	0.6785
No log	6.3019	334	0.4509	0.4507	0.4509	0.6715
No log	6.3396	336	0.4505	0.4857	0.4505	0.6712
No log	6.3774	338	0.4559	0.3284	0.4559	0.6752
No log	6.4151	340	0.4522	0.3284	0.4522	0.6724
No log	6.4528	342	0.4392	0.4857	0.4392	0.6627
No log	6.4906	344	0.4367	0.4507	0.4367	0.6608
No log	6.5283	346	0.4387	0.4545	0.4387	0.6623
No log	6.5660	348	0.4409	0.5455	0.4409	0.6640
No log	6.6038	350	0.4445	0.4857	0.4445	0.6667
No log	6.6415	352	0.4502	0.4324	0.4502	0.6710
No log	6.6792	354	0.4503	0.4348	0.4503	0.6711
No log	6.7170	356	0.4441	0.4857	0.4441	0.6664
No log	6.7547	358	0.4444	0.4857	0.4444	0.6667
No log	6.7925	360	0.4461	0.4857	0.4461	0.6679
No log	6.8302	362	0.4561	0.5217	0.4561	0.6754
No log	6.8679	364	0.4615	0.4706	0.4615	0.6794
No log	6.9057	366	0.4590	0.5217	0.4590	0.6775
No log	6.9434	368	0.4566	0.5217	0.4566	0.6757
No log	6.9811	370	0.4508	0.4857	0.4508	0.6714
No log	7.0189	372	0.4437	0.4507	0.4437	0.6661
No log	7.0566	374	0.4412	0.4507	0.4412	0.6642
No log	7.0943	376	0.4420	0.4507	0.4420	0.6649
No log	7.1321	378	0.4435	0.4857	0.4435	0.6659
No log	7.1698	380	0.4454	0.4507	0.4454	0.6674
No log	7.2075	382	0.4552	0.4304	0.4552	0.6747
No log	7.2453	384	0.4815	0.4304	0.4815	0.6939
No log	7.2830	386	0.4955	0.4304	0.4955	0.7039
No log	7.3208	388	0.4844	0.4304	0.4844	0.6960
No log	7.3585	390	0.4720	0.4304	0.4720	0.6870
No log	7.3962	392	0.4751	0.6053	0.4751	0.6893
No log	7.4340	394	0.4853	0.4179	0.4853	0.6966
No log	7.4717	396	0.4897	0.4545	0.4897	0.6998
No log	7.5094	398	0.4919	0.4545	0.4919	0.7013
No log	7.5472	400	0.4841	0.5135	0.4841	0.6958
No log	7.5849	402	0.4829	0.4615	0.4829	0.6949
No log	7.6226	404	0.4847	0.4615	0.4847	0.6962
No log	7.6604	406	0.4857	0.4615	0.4857	0.6969
No log	7.6981	408	0.4860	0.6053	0.4860	0.6971
No log	7.7358	410	0.4875	0.6053	0.4875	0.6982
No log	7.7736	412	0.4846	0.5714	0.4846	0.6961
No log	7.8113	414	0.4822	0.5385	0.4822	0.6944
No log	7.8491	416	0.4804	0.5385	0.4804	0.6931
No log	7.8868	418	0.4767	0.5385	0.4767	0.6904
No log	7.9245	420	0.4775	0.4304	0.4775	0.6910
No log	7.9623	422	0.4789	0.4304	0.4789	0.6921
No log	8.0	424	0.4772	0.4304	0.4772	0.6908
No log	8.0377	426	0.4777	0.5385	0.4777	0.6912
No log	8.0755	428	0.4847	0.5135	0.4847	0.6962
No log	8.1132	430	0.4990	0.4545	0.4990	0.7064
No log	8.1509	432	0.5086	0.4507	0.5086	0.7131
No log	8.1887	434	0.5079	0.4615	0.5079	0.7126
No log	8.2264	436	0.5029	0.5135	0.5029	0.7091
No log	8.2642	438	0.5008	0.4935	0.5008	0.7076
No log	8.3019	440	0.5061	0.4935	0.5061	0.7114
No log	8.3396	442	0.5135	0.4615	0.5135	0.7166
No log	8.3774	444	0.5224	0.4615	0.5224	0.7228
No log	8.4151	446	0.5202	0.4615	0.5202	0.7212
No log	8.4528	448	0.5089	0.4615	0.5089	0.7134
No log	8.4906	450	0.4983	0.4935	0.4983	0.7059
No log	8.5283	452	0.4958	0.4935	0.4958	0.7041
No log	8.5660	454	0.5057	0.4304	0.5057	0.7111
No log	8.6038	456	0.5219	0.4156	0.5219	0.7224
No log	8.6415	458	0.5310	0.4	0.5310	0.7287
No log	8.6792	460	0.5352	0.4	0.5352	0.7316
No log	8.7170	462	0.5303	0.3846	0.5303	0.7282
No log	8.7547	464	0.5253	0.3846	0.5253	0.7248
No log	8.7925	466	0.5134	0.4304	0.5134	0.7165
No log	8.8302	468	0.5076	0.4304	0.5076	0.7125
No log	8.8679	470	0.5032	0.3200	0.5032	0.7093
No log	8.9057	472	0.4987	0.3684	0.4987	0.7062
No log	8.9434	474	0.4954	0.4935	0.4954	0.7038
No log	8.9811	476	0.4908	0.4935	0.4908	0.7006
No log	9.0189	478	0.4890	0.4935	0.4890	0.6993
No log	9.0566	480	0.4874	0.4935	0.4874	0.6981
No log	9.0943	482	0.4860	0.4935	0.4860	0.6971
No log	9.1321	484	0.4857	0.4935	0.4857	0.6970
No log	9.1698	486	0.4863	0.48	0.4863	0.6974
No log	9.2075	488	0.4859	0.48	0.4859	0.6971
No log	9.2453	490	0.4849	0.48	0.4849	0.6963
No log	9.2830	492	0.4841	0.6053	0.4841	0.6958
No log	9.3208	494	0.4826	0.6053	0.4826	0.6947
No log	9.3585	496	0.4815	0.4935	0.4815	0.6939
No log	9.3962	498	0.4808	0.4935	0.4808	0.6934
0.2765	9.4340	500	0.4803	0.4935	0.4803	0.6930
0.2765	9.4717	502	0.4802	0.4935	0.4802	0.6930
0.2765	9.5094	504	0.4803	0.4935	0.4803	0.6931
0.2765	9.5472	506	0.4804	0.4935	0.4804	0.6931
0.2765	9.5849	508	0.4812	0.4935	0.4812	0.6937
0.2765	9.6226	510	0.4830	0.6053	0.4830	0.6949
0.2765	9.6604	512	0.4848	0.5135	0.4848	0.6963
0.2765	9.6981	514	0.4855	0.5135	0.4855	0.6968
0.2765	9.7358	516	0.4859	0.5135	0.4859	0.6971
0.2765	9.7736	518	0.4861	0.48	0.4861	0.6972
0.2765	9.8113	520	0.4860	0.6053	0.4860	0.6971
0.2765	9.8491	522	0.4861	0.6053	0.4861	0.6972
0.2765	9.8868	524	0.4863	0.4935	0.4863	0.6974
0.2765	9.9245	526	0.4866	0.4935	0.4866	0.6976
0.2765	9.9623	528	0.4868	0.4935	0.4868	0.6977
0.2765	10.0	530	0.4868	0.4935	0.4868	0.6977

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1