Arabic_FineTuningAraBERT_AugV4_k3_task2_organization_fold1

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6775
• Qwk: 0.4419
• Mse: 0.6775
• Rmse: 0.8231

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0364	2	2.6281	0.0201	2.6281	1.6211
No log	0.0727	4	0.9096	0.0	0.9096	0.9538
No log	0.1091	6	0.5834	0.1702	0.5834	0.7638
No log	0.1455	8	0.6220	0.1702	0.6220	0.7887
No log	0.1818	10	0.5384	0.2373	0.5384	0.7338
No log	0.2182	12	0.6245	0.1639	0.6245	0.7902
No log	0.2545	14	0.4770	0.5091	0.4770	0.6906
No log	0.2909	16	0.7516	0.3607	0.7516	0.8670
No log	0.3273	18	1.2172	0.1600	1.2172	1.1032
No log	0.3636	20	1.2145	0.0842	1.2145	1.1021
No log	0.4	22	0.8744	0.0	0.8744	0.9351
No log	0.4364	24	0.6827	0.0870	0.6827	0.8263
No log	0.4727	26	0.6273	0.0400	0.6273	0.7920
No log	0.5091	28	0.6192	0.0	0.6192	0.7869
No log	0.5455	30	0.5784	0.0426	0.5784	0.7605
No log	0.5818	32	0.6859	0.1818	0.6859	0.8282
No log	0.6182	34	1.0410	0.1333	1.0410	1.0203
No log	0.6545	36	1.2047	0.2105	1.2047	1.0976
No log	0.6909	38	0.8514	0.2588	0.8514	0.9227
No log	0.7273	40	0.4365	0.4643	0.4365	0.6607
No log	0.7636	42	0.4346	0.4	0.4346	0.6593
No log	0.8	44	0.4195	0.4	0.4195	0.6477
No log	0.8364	46	0.3941	0.4231	0.3941	0.6278
No log	0.8727	48	0.4229	0.3333	0.4229	0.6503
No log	0.9091	50	0.6103	0.3077	0.6103	0.7812
No log	0.9455	52	0.7244	0.3200	0.7244	0.8511
No log	0.9818	54	0.7884	0.3200	0.7884	0.8879
No log	1.0182	56	0.7597	0.3200	0.7597	0.8716
No log	1.0545	58	0.6016	0.3077	0.6016	0.7756
No log	1.0909	60	0.4532	0.3284	0.4532	0.6732
No log	1.1273	62	0.4159	0.4	0.4159	0.6449
No log	1.1636	64	0.4305	0.4	0.4305	0.6561
No log	1.2	66	0.4545	0.4507	0.4545	0.6742
No log	1.2364	68	0.4473	0.5	0.4473	0.6688
No log	1.2727	70	0.5121	0.4474	0.5121	0.7156
No log	1.3091	72	0.5037	0.4935	0.5037	0.7097
No log	1.3455	74	0.5407	0.4878	0.5407	0.7353
No log	1.3818	76	0.6221	0.4419	0.6221	0.7887
No log	1.4182	78	0.5205	0.5301	0.5205	0.7214
No log	1.4545	80	0.4737	0.5412	0.4737	0.6883
No log	1.4909	82	0.4778	0.5116	0.4778	0.6912
No log	1.5273	84	0.5189	0.4828	0.5189	0.7203
No log	1.5636	86	0.5669	0.5116	0.5669	0.7529
No log	1.6	88	0.5963	0.4935	0.5963	0.7722
No log	1.6364	90	0.5757	0.4167	0.5757	0.7587
No log	1.6727	92	0.5268	0.5063	0.5268	0.7258
No log	1.7091	94	0.5042	0.5063	0.5042	0.7100
No log	1.7455	96	0.4994	0.4615	0.4994	0.7067
No log	1.7818	98	0.5138	0.3684	0.5138	0.7168
No log	1.8182	100	0.4984	0.4156	0.4984	0.7060
No log	1.8545	102	0.4939	0.4615	0.4939	0.7028
No log	1.8909	104	0.4569	0.56	0.4569	0.6759
No log	1.9273	106	0.5023	0.5823	0.5023	0.7087
No log	1.9636	108	0.5557	0.5263	0.5557	0.7454
No log	2.0	110	0.5203	0.5714	0.5203	0.7213
No log	2.0364	112	0.5218	0.5714	0.5218	0.7223
No log	2.0727	114	0.5350	0.5610	0.5350	0.7314
No log	2.1091	116	0.5572	0.5610	0.5572	0.7464
No log	2.1455	118	0.5681	0.5610	0.5681	0.7537
No log	2.1818	120	0.5646	0.4444	0.5646	0.7514
No log	2.2182	122	0.5669	0.5618	0.5669	0.7530
No log	2.2545	124	0.5863	0.5714	0.5863	0.7657
No log	2.2909	126	0.6702	0.4878	0.6702	0.8186
No log	2.3273	128	0.6768	0.5227	0.6768	0.8227
No log	2.3636	130	0.5787	0.5714	0.5787	0.7607
No log	2.4	132	0.5559	0.5500	0.5559	0.7456
No log	2.4364	134	0.5375	0.5500	0.5375	0.7332
No log	2.4727	136	0.5415	0.5063	0.5415	0.7359
No log	2.5091	138	0.6076	0.475	0.6076	0.7795
No log	2.5455	140	0.5439	0.4156	0.5439	0.7375
No log	2.5818	142	0.4823	0.56	0.4823	0.6945
No log	2.6182	144	0.4841	0.4857	0.4841	0.6957
No log	2.6545	146	0.5206	0.5500	0.5206	0.7215
No log	2.6909	148	0.5815	0.5412	0.5815	0.7626
No log	2.7273	150	0.6548	0.5000	0.6548	0.8092
No log	2.7636	152	0.6867	0.5412	0.6867	0.8287
No log	2.8	154	0.7115	0.4419	0.7115	0.8435
No log	2.8364	156	0.7718	0.5500	0.7718	0.8785
No log	2.8727	158	0.7917	0.5301	0.7917	0.8898
No log	2.9091	160	0.8105	0.4419	0.8105	0.9003
No log	2.9455	162	0.8288	0.4578	0.8288	0.9104
No log	2.9818	164	0.8332	0.4578	0.8332	0.9128
No log	3.0182	166	0.8553	0.4578	0.8553	0.9248
No log	3.0545	168	0.8199	0.4578	0.8199	0.9055
No log	3.0909	170	0.7167	0.3200	0.7167	0.8466
No log	3.1273	172	0.6847	0.3684	0.6847	0.8275
No log	3.1636	174	0.6729	0.3684	0.6729	0.8203
No log	3.2	176	0.7108	0.4578	0.7108	0.8431
No log	3.2364	178	0.8995	0.4878	0.8995	0.9484
No log	3.2727	180	0.9104	0.4878	0.9104	0.9542
No log	3.3091	182	0.7686	0.4878	0.7686	0.8767
No log	3.3455	184	0.6592	0.4	0.6592	0.8119
No log	3.3818	186	0.6762	0.4828	0.6762	0.8223
No log	3.4182	188	0.6928	0.4146	0.6928	0.8323
No log	3.4545	190	0.7171	0.4375	0.7171	0.8468
No log	3.4909	192	0.7046	0.4600	0.7046	0.8394
No log	3.5273	194	0.6908	0.4	0.6908	0.8311
No log	3.5636	196	0.6336	0.3684	0.6336	0.7960
No log	3.6	198	0.6043	0.48	0.6043	0.7773
No log	3.6364	200	0.6165	0.5000	0.6165	0.7852
No log	3.6727	202	0.6005	0.5063	0.6005	0.7749
No log	3.7091	204	0.6016	0.5000	0.6016	0.7757
No log	3.7455	206	0.6109	0.4578	0.6109	0.7816
No log	3.7818	208	0.6166	0.3846	0.6166	0.7853
No log	3.8182	210	0.5886	0.3836	0.5886	0.7672
No log	3.8545	212	0.5506	0.48	0.5506	0.7420
No log	3.8909	214	0.5488	0.3684	0.5488	0.7408
No log	3.9273	216	0.5546	0.48	0.5546	0.7447
No log	3.9636	218	0.5770	0.4324	0.5770	0.7596
No log	4.0	220	0.6527	0.4615	0.6527	0.8079
No log	4.0364	222	0.7713	0.4156	0.7713	0.8782
No log	4.0727	224	0.7381	0.4156	0.7381	0.8591
No log	4.1091	226	0.6192	0.5063	0.6192	0.7869
No log	4.1455	228	0.5687	0.3662	0.5687	0.7541
No log	4.1818	230	0.6120	0.4348	0.6120	0.7823
No log	4.2182	232	0.6421	0.4000	0.6421	0.8013
No log	4.2545	234	0.5828	0.4167	0.5828	0.7634
No log	4.2909	236	0.5876	0.4444	0.5876	0.7665
No log	4.3273	238	0.6366	0.4444	0.6366	0.7979
No log	4.3636	240	0.6362	0.4444	0.6362	0.7976
No log	4.4	242	0.6217	0.4444	0.6217	0.7885
No log	4.4364	244	0.6089	0.4444	0.6089	0.7803
No log	4.4727	246	0.6046	0.4444	0.6046	0.7776
No log	4.5091	248	0.6090	0.4146	0.6090	0.7804
No log	4.5455	250	0.6270	0.4146	0.6270	0.7918
No log	4.5818	252	0.6328	0.4146	0.6328	0.7955
No log	4.6182	254	0.6377	0.4146	0.6377	0.7986
No log	4.6545	256	0.6845	0.5063	0.6845	0.8273
No log	4.6909	258	0.7278	0.4578	0.7278	0.8531
No log	4.7273	260	0.6722	0.4578	0.6722	0.8199
No log	4.7636	262	0.6237	0.5063	0.6237	0.7898
No log	4.8	264	0.6155	0.3836	0.6155	0.7845
No log	4.8364	266	0.6010	0.3836	0.6010	0.7752
No log	4.8727	268	0.6127	0.3836	0.6127	0.7827
No log	4.9091	270	0.6335	0.3571	0.6335	0.7959
No log	4.9455	272	0.6596	0.3571	0.6596	0.8121
No log	4.9818	274	0.6535	0.4419	0.6535	0.8084
No log	5.0182	276	0.6580	0.4419	0.6580	0.8112
No log	5.0545	278	0.6495	0.5301	0.6495	0.8059
No log	5.0909	280	0.6768	0.5823	0.6768	0.8226
No log	5.1273	282	0.6791	0.5823	0.6791	0.8240
No log	5.1636	284	0.6408	0.5823	0.6408	0.8005
No log	5.2	286	0.6226	0.5227	0.6226	0.7891
No log	5.2364	288	0.6244	0.4419	0.6244	0.7902
No log	5.2727	290	0.6167	0.4419	0.6167	0.7853
No log	5.3091	292	0.5980	0.4419	0.5980	0.7733
No log	5.3455	294	0.5939	0.4658	0.5939	0.7706
No log	5.3818	296	0.6045	0.4658	0.6045	0.7775
No log	5.4182	298	0.5968	0.4658	0.5968	0.7725
No log	5.4545	300	0.6031	0.3377	0.6031	0.7766
No log	5.4909	302	0.6381	0.3704	0.6381	0.7988
No log	5.5273	304	0.6752	0.4578	0.6752	0.8217
No log	5.5636	306	0.6703	0.3846	0.6703	0.8187
No log	5.6	308	0.6462	0.3704	0.6462	0.8039
No log	5.6364	310	0.6361	0.3377	0.6361	0.7976
No log	5.6727	312	0.6388	0.3377	0.6388	0.7992
No log	5.7091	314	0.6521	0.3333	0.6521	0.8075
No log	5.7455	316	0.6807	0.3284	0.6807	0.8250
No log	5.7818	318	0.6720	0.3333	0.6720	0.8198
No log	5.8182	320	0.6435	0.3333	0.6435	0.8022
No log	5.8545	322	0.6655	0.4000	0.6655	0.8158
No log	5.8909	324	0.7216	0.4578	0.7216	0.8495
No log	5.9273	326	0.7318	0.4578	0.7318	0.8555
No log	5.9636	328	0.7045	0.4578	0.7045	0.8393
No log	6.0	330	0.6954	0.4578	0.6954	0.8339
No log	6.0364	332	0.6648	0.4304	0.6648	0.8154
No log	6.0727	334	0.6365	0.4000	0.6365	0.7978
No log	6.1091	336	0.6255	0.4	0.6255	0.7909
No log	6.1455	338	0.6361	0.4000	0.6361	0.7976
No log	6.1818	340	0.6719	0.5000	0.6719	0.8197
No log	6.2182	342	0.6830	0.5000	0.6830	0.8265
No log	6.2545	344	0.6949	0.5000	0.6949	0.8336
No log	6.2909	346	0.6512	0.5000	0.6512	0.8070
No log	6.3273	348	0.6057	0.4156	0.6057	0.7783
No log	6.3636	350	0.5951	0.3333	0.5951	0.7714
No log	6.4	352	0.5973	0.3333	0.5973	0.7729
No log	6.4364	354	0.5964	0.3333	0.5964	0.7723
No log	6.4727	356	0.6014	0.4156	0.6014	0.7755
No log	6.5091	358	0.6173	0.4146	0.6173	0.7857
No log	6.5455	360	0.6406	0.5000	0.6406	0.8003
No log	6.5818	362	0.6527	0.5000	0.6527	0.8079
No log	6.6182	364	0.6620	0.5000	0.6620	0.8137
No log	6.6545	366	0.6492	0.5000	0.6492	0.8057
No log	6.6909	368	0.6373	0.4419	0.6373	0.7983
No log	6.7273	370	0.6502	0.3836	0.6502	0.8064
No log	6.7636	372	0.6764	0.3836	0.6764	0.8224
No log	6.8	374	0.6960	0.5135	0.6960	0.8343
No log	6.8364	376	0.6908	0.4615	0.6908	0.8311
No log	6.8727	378	0.6741	0.4578	0.6741	0.8210
No log	6.9091	380	0.6604	0.4419	0.6604	0.8127
No log	6.9455	382	0.6553	0.5412	0.6553	0.8095
No log	6.9818	384	0.6609	0.5000	0.6609	0.8130
No log	7.0182	386	0.6563	0.5000	0.6563	0.8101
No log	7.0545	388	0.6457	0.4304	0.6457	0.8035
No log	7.0909	390	0.6314	0.475	0.6314	0.7946
No log	7.1273	392	0.6315	0.475	0.6315	0.7947
No log	7.1636	394	0.6412	0.475	0.6412	0.8007
No log	7.2	396	0.6518	0.5116	0.6518	0.8073
No log	7.2364	398	0.6517	0.4138	0.6517	0.8073
No log	7.2727	400	0.6535	0.4138	0.6535	0.8084
No log	7.3091	402	0.6586	0.4138	0.6586	0.8116
No log	7.3455	404	0.6673	0.4578	0.6673	0.8169
No log	7.3818	406	0.6658	0.4138	0.6658	0.8160
No log	7.4182	408	0.6642	0.4138	0.6642	0.8150
No log	7.4545	410	0.6629	0.4138	0.6629	0.8142
No log	7.4909	412	0.6649	0.5116	0.6649	0.8154
No log	7.5273	414	0.6580	0.5116	0.6580	0.8112
No log	7.5636	416	0.6465	0.4138	0.6465	0.8040
No log	7.6	418	0.6354	0.4138	0.6354	0.7971
No log	7.6364	420	0.6315	0.5116	0.6315	0.7947
No log	7.6727	422	0.6370	0.5412	0.6370	0.7981
No log	7.7091	424	0.6422	0.5000	0.6422	0.8013
No log	7.7455	426	0.6414	0.5000	0.6414	0.8009
No log	7.7818	428	0.6314	0.5000	0.6314	0.7946
No log	7.8182	430	0.6258	0.5000	0.6258	0.7911
No log	7.8545	432	0.6259	0.5000	0.6259	0.7911
No log	7.8909	434	0.6312	0.5000	0.6312	0.7945
No log	7.9273	436	0.6329	0.5000	0.6329	0.7955
No log	7.9636	438	0.6317	0.5000	0.6317	0.7948
No log	8.0	440	0.6438	0.5000	0.6438	0.8024
No log	8.0364	442	0.6565	0.5412	0.6565	0.8102
No log	8.0727	444	0.6721	0.5412	0.6721	0.8198
No log	8.1091	446	0.6807	0.4419	0.6807	0.8250
No log	8.1455	448	0.6794	0.4138	0.6794	0.8242
No log	8.1818	450	0.6783	0.4138	0.6783	0.8236
No log	8.2182	452	0.6818	0.4146	0.6818	0.8257
No log	8.2545	454	0.6872	0.4146	0.6872	0.8290
No log	8.2909	456	0.6855	0.4146	0.6855	0.8280
No log	8.3273	458	0.6836	0.4146	0.6836	0.8268
No log	8.3636	460	0.6806	0.4146	0.6806	0.8250
No log	8.4	462	0.6750	0.4138	0.6750	0.8216
No log	8.4364	464	0.6694	0.4419	0.6694	0.8182
No log	8.4727	466	0.6659	0.4419	0.6659	0.8160
No log	8.5091	468	0.6674	0.4419	0.6674	0.8170
No log	8.5455	470	0.6670	0.5412	0.6670	0.8167
No log	8.5818	472	0.6672	0.4419	0.6672	0.8168
No log	8.6182	474	0.6662	0.3704	0.6662	0.8162
No log	8.6545	476	0.6698	0.3704	0.6698	0.8184
No log	8.6909	478	0.6700	0.3704	0.6700	0.8185
No log	8.7273	480	0.6713	0.3704	0.6713	0.8193
No log	8.7636	482	0.6721	0.3704	0.6721	0.8198
No log	8.8	484	0.6774	0.4419	0.6774	0.8230
No log	8.8364	486	0.6846	0.5412	0.6846	0.8274
No log	8.8727	488	0.6902	0.5412	0.6902	0.8308
No log	8.9091	490	0.6962	0.4419	0.6962	0.8344
No log	8.9455	492	0.7008	0.4419	0.7008	0.8371
No log	8.9818	494	0.7001	0.4138	0.7001	0.8367
No log	9.0182	496	0.7026	0.4138	0.7026	0.8382
No log	9.0545	498	0.7077	0.4138	0.7077	0.8412
0.3179	9.0909	500	0.7118	0.4138	0.7118	0.8437
0.3179	9.1273	502	0.7134	0.4146	0.7134	0.8446
0.3179	9.1636	504	0.7108	0.4146	0.7108	0.8431
0.3179	9.2	506	0.7089	0.4138	0.7089	0.8420
0.3179	9.2364	508	0.7045	0.4138	0.7045	0.8393
0.3179	9.2727	510	0.6989	0.4138	0.6989	0.8360
0.3179	9.3091	512	0.6930	0.4138	0.6930	0.8325
0.3179	9.3455	514	0.6908	0.4419	0.6908	0.8312
0.3179	9.3818	516	0.6892	0.4419	0.6892	0.8302
0.3179	9.4182	518	0.6885	0.5000	0.6885	0.8298
0.3179	9.4545	520	0.6865	0.5000	0.6865	0.8285
0.3179	9.4909	522	0.6840	0.5000	0.6840	0.8271
0.3179	9.5273	524	0.6818	0.5000	0.6818	0.8257
0.3179	9.5636	526	0.6817	0.5000	0.6817	0.8256
0.3179	9.6	528	0.6805	0.5000	0.6805	0.8249
0.3179	9.6364	530	0.6809	0.5000	0.6809	0.8252
0.3179	9.6727	532	0.6820	0.5000	0.6820	0.8258
0.3179	9.7091	534	0.6819	0.5000	0.6819	0.8258
0.3179	9.7455	536	0.6806	0.4	0.6806	0.8250
0.3179	9.7818	538	0.6791	0.4	0.6791	0.8241
0.3179	9.8182	540	0.6782	0.4419	0.6782	0.8235
0.3179	9.8545	542	0.6782	0.4419	0.6782	0.8235
0.3179	9.8909	544	0.6779	0.4419	0.6779	0.8234
0.3179	9.9273	546	0.6777	0.4419	0.6777	0.8232
0.3179	9.9636	548	0.6775	0.4419	0.6775	0.8231
0.3179	10.0	550	0.6775	0.4419	0.6775	0.8231

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1