Arabic_FineTuningAraBERT_AugV5_k5_task5_organization_fold1

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9557
• Qwk: 0.5414
• Mse: 0.9557
• Rmse: 0.9776

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0625	2	2.2311	0.0	2.2311	1.4937
No log	0.125	4	1.4266	-0.1148	1.4266	1.1944
No log	0.1875	6	1.8042	-0.0169	1.8042	1.3432
No log	0.25	8	1.5872	0.1944	1.5872	1.2598
No log	0.3125	10	1.2591	0.0820	1.2591	1.1221
No log	0.375	12	1.5485	0.2736	1.5485	1.2444
No log	0.4375	14	1.8543	0.3498	1.8543	1.3617
No log	0.5	16	1.2394	0.3350	1.2394	1.1133
No log	0.5625	18	0.9220	0.3201	0.9220	0.9602
No log	0.625	20	0.9742	0.4199	0.9742	0.9870
No log	0.6875	22	0.8488	0.5058	0.8488	0.9213
No log	0.75	24	0.8004	0.2675	0.8004	0.8947
No log	0.8125	26	1.0149	0.3696	1.0149	1.0074
No log	0.875	28	0.9474	0.4167	0.9474	0.9733
No log	0.9375	30	0.7521	0.3713	0.7521	0.8672
No log	1.0	32	0.8620	0.4828	0.8620	0.9284
No log	1.0625	34	1.0908	0.2279	1.0908	1.0444
No log	1.125	36	1.1308	0.2171	1.1308	1.0634
No log	1.1875	38	1.1594	0.2279	1.1594	1.0767
No log	1.25	40	1.2134	0.0	1.2134	1.1016
No log	1.3125	42	1.2278	0.0	1.2278	1.1081
No log	1.375	44	1.1421	0.0	1.1421	1.0687
No log	1.4375	46	1.0638	0.0	1.0638	1.0314
No log	1.5	48	0.9935	0.0805	0.9935	0.9968
No log	1.5625	50	0.9358	0.2279	0.9358	0.9674
No log	1.625	52	0.8997	0.3594	0.8997	0.9485
No log	1.6875	54	0.8799	0.3691	0.8799	0.9380
No log	1.75	56	0.8639	0.3060	0.8639	0.9294
No log	1.8125	58	0.8450	0.4020	0.8450	0.9193
No log	1.875	60	0.8352	0.4020	0.8352	0.9139
No log	1.9375	62	0.8233	0.4020	0.8233	0.9074
No log	2.0	64	0.8058	0.4020	0.8058	0.8977
No log	2.0625	66	0.7999	0.5252	0.7999	0.8944
No log	2.125	68	0.7699	0.4509	0.7699	0.8774
No log	2.1875	70	0.7134	0.5016	0.7134	0.8446
No log	2.25	72	0.6841	0.5918	0.6841	0.8271
No log	2.3125	74	0.6521	0.5989	0.6521	0.8076
No log	2.375	76	0.6222	0.5430	0.6222	0.7888
No log	2.4375	78	0.6073	0.5355	0.6073	0.7793
No log	2.5	80	0.6963	0.5550	0.6963	0.8344
No log	2.5625	82	0.8117	0.5687	0.8117	0.9009
No log	2.625	84	0.8364	0.5687	0.8364	0.9145
No log	2.6875	86	0.7255	0.5687	0.7255	0.8518
No log	2.75	88	0.6405	0.5856	0.6405	0.8003
No log	2.8125	90	0.6037	0.5879	0.6037	0.7770
No log	2.875	92	0.5944	0.5733	0.5944	0.7710
No log	2.9375	94	0.6245	0.5710	0.6245	0.7903
No log	3.0	96	0.7197	0.5856	0.7197	0.8483
No log	3.0625	98	0.8789	0.5687	0.8789	0.9375
No log	3.125	100	0.9224	0.5687	0.9224	0.9604
No log	3.1875	102	0.8294	0.5550	0.8294	0.9107
No log	3.25	104	0.6976	0.6479	0.6976	0.8353
No log	3.3125	106	0.6311	0.6643	0.6311	0.7944
No log	3.375	108	0.6553	0.6643	0.6553	0.8095
No log	3.4375	110	0.6988	0.6462	0.6988	0.8359
No log	3.5	112	0.6370	0.6643	0.6370	0.7981
No log	3.5625	114	0.5809	0.6977	0.5809	0.7622
No log	3.625	116	0.5615	0.7136	0.5615	0.7494
No log	3.6875	118	0.6368	0.6456	0.6368	0.7980
No log	3.75	120	0.6936	0.6462	0.6936	0.8328
No log	3.8125	122	0.7154	0.6456	0.7154	0.8458
No log	3.875	124	0.7113	0.6456	0.7113	0.8434
No log	3.9375	126	0.7150	0.6603	0.7150	0.8456
No log	4.0	128	0.8125	0.6468	0.8125	0.9014
No log	4.0625	130	0.9164	0.5978	0.9164	0.9573
No log	4.125	132	0.9227	0.6082	0.9227	0.9606
No log	4.1875	134	0.8181	0.6071	0.8181	0.9045
No log	4.25	136	0.6983	0.6334	0.6983	0.8357
No log	4.3125	138	0.6501	0.7072	0.6501	0.8063
No log	4.375	140	0.6355	0.6226	0.6355	0.7972
No log	4.4375	142	0.6495	0.6531	0.6495	0.8059
No log	4.5	144	0.7068	0.6075	0.7068	0.8407
No log	4.5625	146	0.8148	0.6219	0.8148	0.9027
No log	4.625	148	1.0364	0.6141	1.0364	1.0180
No log	4.6875	150	1.2129	0.5552	1.2129	1.1013
No log	4.75	152	1.2586	0.5075	1.2586	1.1219
No log	4.8125	154	1.1702	0.5956	1.1702	1.0818
No log	4.875	156	1.0328	0.5805	1.0328	1.0163
No log	4.9375	158	0.9185	0.6473	0.9185	0.9584
No log	5.0	160	0.8699	0.6713	0.8699	0.9327
No log	5.0625	162	0.8857	0.7059	0.8857	0.9411
No log	5.125	164	0.9931	0.6477	0.9931	0.9965
No log	5.1875	166	1.1422	0.5229	1.1422	1.0687
No log	5.25	168	1.2604	0.4671	1.2604	1.1227
No log	5.3125	170	1.1892	0.5229	1.1892	1.0905
No log	5.375	172	0.9707	0.5946	0.9707	0.9852
No log	5.4375	174	0.7593	0.6334	0.7593	0.8714
No log	5.5	176	0.7083	0.6360	0.7083	0.8416
No log	5.5625	178	0.7392	0.6360	0.7392	0.8598
No log	5.625	180	0.7600	0.6494	0.7600	0.8718
No log	5.6875	182	0.7954	0.6494	0.7954	0.8918
No log	5.75	184	0.8010	0.6510	0.8010	0.8950
No log	5.8125	186	0.8042	0.6510	0.8042	0.8968
No log	5.875	188	0.8676	0.6034	0.8676	0.9314
No log	5.9375	190	1.0048	0.5414	1.0048	1.0024
No log	6.0	192	1.0556	0.5805	1.0556	1.0274
No log	6.0625	194	1.0053	0.5805	1.0053	1.0026
No log	6.125	196	0.9765	0.6473	0.9765	0.9882
No log	6.1875	198	0.9214	0.6097	0.9214	0.9599
No log	6.25	200	0.8751	0.6357	0.8751	0.9355
No log	6.3125	202	0.8639	0.6346	0.8639	0.9295
No log	6.375	204	0.8814	0.6346	0.8814	0.9388
No log	6.4375	206	0.8793	0.6346	0.8793	0.9377
No log	6.5	208	0.8385	0.6346	0.8385	0.9157
No log	6.5625	210	0.7968	0.6888	0.7968	0.8926
No log	6.625	212	0.7881	0.6755	0.7881	0.8877
No log	6.6875	214	0.8019	0.6755	0.8019	0.8955
No log	6.75	216	0.8650	0.6346	0.8650	0.9301
No log	6.8125	218	0.9387	0.6097	0.9387	0.9688
No log	6.875	220	0.9676	0.6097	0.9676	0.9837
No log	6.9375	222	0.9460	0.6097	0.9460	0.9726
No log	7.0	224	0.8848	0.6600	0.8848	0.9406
No log	7.0625	226	0.8759	0.6600	0.8759	0.9359
No log	7.125	228	0.8706	0.6600	0.8706	0.9330
No log	7.1875	230	0.8652	0.6600	0.8652	0.9302
No log	7.25	232	0.8643	0.6464	0.8643	0.9297
No log	7.3125	234	0.8673	0.6464	0.8673	0.9313
No log	7.375	236	0.8292	0.6741	0.8292	0.9106
No log	7.4375	238	0.7808	0.6756	0.7808	0.8836
No log	7.5	240	0.7578	0.6756	0.7578	0.8705
No log	7.5625	242	0.7568	0.6756	0.7568	0.8699
No log	7.625	244	0.7604	0.6756	0.7604	0.8720
No log	7.6875	246	0.7670	0.6756	0.7670	0.8758
No log	7.75	248	0.8027	0.6491	0.8027	0.8960
No log	7.8125	250	0.8444	0.6494	0.8444	0.9189
No log	7.875	252	0.8757	0.6494	0.8757	0.9358
No log	7.9375	254	0.8958	0.5690	0.8958	0.9465
No log	8.0	256	0.9390	0.5782	0.9390	0.9690
No log	8.0625	258	0.9849	0.5878	0.9849	0.9924
No log	8.125	260	1.0027	0.5504	1.0027	1.0013
No log	8.1875	262	1.0154	0.6205	1.0154	1.0076
No log	8.25	264	1.0071	0.6586	1.0071	1.0035
No log	8.3125	266	0.9719	0.6464	0.9719	0.9859
No log	8.375	268	0.9266	0.6464	0.9266	0.9626
No log	8.4375	270	0.8809	0.6464	0.8809	0.9386
No log	8.5	272	0.8470	0.6464	0.8470	0.9203
No log	8.5625	274	0.8357	0.6731	0.8357	0.9142
No log	8.625	276	0.8113	0.6869	0.8113	0.9007
No log	8.6875	278	0.7956	0.6743	0.7956	0.8919
No log	8.75	280	0.7933	0.6743	0.7933	0.8907
No log	8.8125	282	0.7964	0.6743	0.7964	0.8924
No log	8.875	284	0.8141	0.6743	0.8141	0.9023
No log	8.9375	286	0.8444	0.6743	0.8444	0.9189
No log	9.0	288	0.8916	0.6731	0.8916	0.9443
No log	9.0625	290	0.9434	0.6357	0.9434	0.9713
No log	9.125	292	0.9759	0.6097	0.9759	0.9879
No log	9.1875	294	0.9987	0.6097	0.9987	0.9994
No log	9.25	296	1.0093	0.6473	1.0093	1.0047
No log	9.3125	298	1.0157	0.6473	1.0157	1.0078
No log	9.375	300	1.0145	0.5414	1.0145	1.0072
No log	9.4375	302	1.0064	0.5414	1.0064	1.0032
No log	9.5	304	0.9907	0.5414	0.9907	0.9953
No log	9.5625	306	0.9848	0.5414	0.9848	0.9924
No log	9.625	308	0.9766	0.5414	0.9766	0.9882
No log	9.6875	310	0.9675	0.5414	0.9675	0.9836
No log	9.75	312	0.9617	0.5414	0.9617	0.9807
No log	9.8125	314	0.9601	0.5414	0.9601	0.9798
No log	9.875	316	0.9593	0.5414	0.9593	0.9795
No log	9.9375	318	0.9570	0.5414	0.9570	0.9783
No log	10.0	320	0.9557	0.5414	0.9557	0.9776

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1