ArabicNewSplits6_FineTuningAraBERT_run2_AugV5_k12_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5810
• Qwk: 0.7399
• Mse: 0.5810
• Rmse: 0.7623

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0328	2	5.4124	-0.0207	5.4124	2.3265
No log	0.0656	4	3.2313	0.0801	3.2313	1.7976
No log	0.0984	6	2.0536	-0.0045	2.0536	1.4330
No log	0.1311	8	2.6242	-0.1555	2.6242	1.6199
No log	0.1639	10	2.2552	-0.1315	2.2552	1.5017
No log	0.1967	12	1.4546	0.0272	1.4546	1.2061
No log	0.2295	14	1.3484	0.0917	1.3484	1.1612
No log	0.2623	16	1.3480	0.0849	1.3480	1.1610
No log	0.2951	18	1.3873	0.0815	1.3873	1.1778
No log	0.3279	20	1.4225	0.1057	1.4225	1.1927
No log	0.3607	22	1.5735	-0.1184	1.5735	1.2544
No log	0.3934	24	1.5271	-0.1184	1.5271	1.2358
No log	0.4262	26	1.4822	-0.0294	1.4822	1.2175
No log	0.4590	28	1.3901	0.0651	1.3901	1.1790
No log	0.4918	30	1.4198	0.0493	1.4198	1.1916
No log	0.5246	32	1.3779	0.0684	1.3779	1.1738
No log	0.5574	34	1.6410	0.0712	1.6410	1.2810
No log	0.5902	36	2.1906	0.1598	2.1906	1.4801
No log	0.6230	38	2.2179	0.1791	2.2179	1.4893
No log	0.6557	40	1.8201	0.1682	1.8201	1.3491
No log	0.6885	42	1.2725	0.2132	1.2725	1.1281
No log	0.7213	44	1.0607	0.4013	1.0607	1.0299
No log	0.7541	46	1.0338	0.4206	1.0338	1.0167
No log	0.7869	48	1.1105	0.4153	1.1105	1.0538
No log	0.8197	50	1.1334	0.4079	1.1334	1.0646
No log	0.8525	52	0.9385	0.5472	0.9385	0.9688
No log	0.8852	54	0.8455	0.5395	0.8455	0.9195
No log	0.9180	56	0.7681	0.5798	0.7681	0.8764
No log	0.9508	58	0.7509	0.6360	0.7509	0.8665
No log	0.9836	60	1.0321	0.4681	1.0321	1.0159
No log	1.0164	62	1.0771	0.4579	1.0771	1.0378
No log	1.0492	64	0.7115	0.6511	0.7115	0.8435
No log	1.0820	66	0.7524	0.6395	0.7524	0.8674
No log	1.1148	68	0.9825	0.4967	0.9825	0.9912
No log	1.1475	70	0.7253	0.6404	0.7253	0.8517
No log	1.1803	72	0.6255	0.6912	0.6255	0.7909
No log	1.2131	74	1.0399	0.5681	1.0399	1.0198
No log	1.2459	76	1.4067	0.4425	1.4067	1.1860
No log	1.2787	78	1.3140	0.4447	1.3140	1.1463
No log	1.3115	80	0.9467	0.4987	0.9467	0.9730
No log	1.3443	82	0.6284	0.6763	0.6284	0.7927
No log	1.3770	84	0.6878	0.6606	0.6878	0.8293
No log	1.4098	86	0.7670	0.6368	0.7670	0.8758
No log	1.4426	88	0.6454	0.7041	0.6454	0.8034
No log	1.4754	90	0.5964	0.7047	0.5964	0.7722
No log	1.5082	92	0.8652	0.6190	0.8652	0.9302
No log	1.5410	94	0.9266	0.5644	0.9266	0.9626
No log	1.5738	96	0.7493	0.6410	0.7493	0.8656
No log	1.6066	98	0.6678	0.6568	0.6678	0.8172
No log	1.6393	100	0.6144	0.6459	0.6144	0.7838
No log	1.6721	102	0.6367	0.6529	0.6367	0.7979
No log	1.7049	104	0.6793	0.6419	0.6793	0.8242
No log	1.7377	106	0.6769	0.6437	0.6769	0.8227
No log	1.7705	108	0.6155	0.6914	0.6155	0.7846
No log	1.8033	110	0.5825	0.7291	0.5825	0.7632
No log	1.8361	112	0.5869	0.6856	0.5869	0.7661
No log	1.8689	114	0.6356	0.6890	0.6356	0.7973
No log	1.9016	116	0.6384	0.7007	0.6384	0.7990
No log	1.9344	118	0.6608	0.7	0.6608	0.8129
No log	1.9672	120	0.6638	0.6975	0.6638	0.8148
No log	2.0	122	0.7223	0.6564	0.7223	0.8499
No log	2.0328	124	0.8115	0.6047	0.8115	0.9009
No log	2.0656	126	0.7698	0.6380	0.7698	0.8774
No log	2.0984	128	0.7951	0.6111	0.7951	0.8917
No log	2.1311	130	0.9564	0.5050	0.9564	0.9779
No log	2.1639	132	1.1341	0.4742	1.1341	1.0649
No log	2.1967	134	1.1265	0.4394	1.1265	1.0614
No log	2.2295	136	0.8912	0.5463	0.8912	0.9440
No log	2.2623	138	0.7247	0.5897	0.7247	0.8513
No log	2.2951	140	0.7824	0.5280	0.7824	0.8845
No log	2.3279	142	0.7913	0.5402	0.7913	0.8896
No log	2.3607	144	0.6721	0.5869	0.6721	0.8198
No log	2.3934	146	0.7240	0.6237	0.7240	0.8509
No log	2.4262	148	1.0915	0.4408	1.0915	1.0448
No log	2.4590	150	1.2612	0.3991	1.2612	1.1230
No log	2.4918	152	1.0643	0.4776	1.0643	1.0316
No log	2.5246	154	0.7555	0.5793	0.7555	0.8692
No log	2.5574	156	0.6567	0.6612	0.6567	0.8104
No log	2.5902	158	0.6328	0.6768	0.6328	0.7955
No log	2.6230	160	0.5941	0.6868	0.5941	0.7708
No log	2.6557	162	0.6013	0.6973	0.6013	0.7754
No log	2.6885	164	0.5883	0.7034	0.5883	0.7670
No log	2.7213	166	0.5811	0.6989	0.5811	0.7623
No log	2.7541	168	0.5639	0.6952	0.5639	0.7509
No log	2.7869	170	0.5641	0.6993	0.5641	0.7511
No log	2.8197	172	0.5429	0.7044	0.5429	0.7368
No log	2.8525	174	0.5276	0.7311	0.5276	0.7263
No log	2.8852	176	0.5164	0.7280	0.5164	0.7186
No log	2.9180	178	0.5328	0.7224	0.5328	0.7299
No log	2.9508	180	0.6007	0.7133	0.6007	0.7751
No log	2.9836	182	0.5874	0.7156	0.5874	0.7664
No log	3.0164	184	0.5180	0.7422	0.5180	0.7197
No log	3.0492	186	0.5088	0.7129	0.5088	0.7133
No log	3.0820	188	0.5576	0.7357	0.5576	0.7467
No log	3.1148	190	0.5332	0.7486	0.5332	0.7302
No log	3.1475	192	0.5084	0.7484	0.5084	0.7130
No log	3.1803	194	0.5933	0.7164	0.5933	0.7703
No log	3.2131	196	0.6290	0.7098	0.6290	0.7931
No log	3.2459	198	0.6128	0.7048	0.6128	0.7828
No log	3.2787	200	0.6000	0.6834	0.6000	0.7746
No log	3.3115	202	0.5577	0.7241	0.5577	0.7468
No log	3.3443	204	0.5278	0.7332	0.5278	0.7265
No log	3.3770	206	0.5192	0.7386	0.5192	0.7205
No log	3.4098	208	0.5325	0.7244	0.5325	0.7297
No log	3.4426	210	0.6056	0.6969	0.6056	0.7782
No log	3.4754	212	0.7453	0.6723	0.7453	0.8633
No log	3.5082	214	0.7685	0.6631	0.7685	0.8767
No log	3.5410	216	0.7055	0.6789	0.7055	0.8399
No log	3.5738	218	0.5780	0.7334	0.5780	0.7602
No log	3.6066	220	0.5275	0.712	0.5275	0.7263
No log	3.6393	222	0.5512	0.7070	0.5512	0.7424
No log	3.6721	224	0.6135	0.6662	0.6135	0.7833
No log	3.7049	226	0.5917	0.6713	0.5917	0.7692
No log	3.7377	228	0.5534	0.7026	0.5534	0.7439
No log	3.7705	230	0.5947	0.7317	0.5947	0.7712
No log	3.8033	232	0.6122	0.7285	0.6122	0.7824
No log	3.8361	234	0.5754	0.7295	0.5754	0.7586
No log	3.8689	236	0.5543	0.7405	0.5543	0.7445
No log	3.9016	238	0.5724	0.7006	0.5724	0.7566
No log	3.9344	240	0.7276	0.6235	0.7276	0.8530
No log	3.9672	242	0.8465	0.6155	0.8465	0.9201
No log	4.0	244	0.7736	0.6363	0.7736	0.8796
No log	4.0328	246	0.6440	0.6758	0.6440	0.8025
No log	4.0656	248	0.5762	0.7075	0.5762	0.7591
No log	4.0984	250	0.5520	0.7081	0.5520	0.7430
No log	4.1311	252	0.5451	0.7150	0.5451	0.7383
No log	4.1639	254	0.5413	0.7031	0.5413	0.7358
No log	4.1967	256	0.5470	0.7096	0.5470	0.7396
No log	4.2295	258	0.5441	0.7096	0.5441	0.7376
No log	4.2623	260	0.5290	0.7218	0.5290	0.7273
No log	4.2951	262	0.5443	0.7500	0.5443	0.7377
No log	4.3279	264	0.5557	0.7513	0.5557	0.7454
No log	4.3607	266	0.5908	0.7407	0.5908	0.7687
No log	4.3934	268	0.5694	0.7463	0.5694	0.7546
No log	4.4262	270	0.5665	0.7463	0.5665	0.7527
No log	4.4590	272	0.5524	0.7534	0.5524	0.7432
No log	4.4918	274	0.5368	0.7463	0.5368	0.7327
No log	4.5246	276	0.5722	0.7468	0.5722	0.7564
No log	4.5574	278	0.5977	0.7268	0.5977	0.7731
No log	4.5902	280	0.6078	0.7268	0.6078	0.7796
No log	4.6230	282	0.6044	0.7397	0.6044	0.7774
No log	4.6557	284	0.5621	0.7279	0.5621	0.7497
No log	4.6885	286	0.5352	0.7626	0.5352	0.7316
No log	4.7213	288	0.5318	0.7523	0.5318	0.7292
No log	4.7541	290	0.5226	0.7603	0.5226	0.7229
No log	4.7869	292	0.5273	0.7683	0.5273	0.7262
No log	4.8197	294	0.5248	0.7575	0.5248	0.7245
No log	4.8525	296	0.5264	0.7703	0.5264	0.7255
No log	4.8852	298	0.5389	0.7625	0.5389	0.7341
No log	4.9180	300	0.5357	0.7527	0.5357	0.7319
No log	4.9508	302	0.5397	0.7585	0.5397	0.7346
No log	4.9836	304	0.5414	0.7476	0.5414	0.7358
No log	5.0164	306	0.5373	0.7648	0.5373	0.7330
No log	5.0492	308	0.5375	0.7623	0.5375	0.7332
No log	5.0820	310	0.5347	0.7693	0.5347	0.7312
No log	5.1148	312	0.5331	0.7673	0.5331	0.7301
No log	5.1475	314	0.5362	0.7514	0.5362	0.7323
No log	5.1803	316	0.5432	0.7337	0.5432	0.7370
No log	5.2131	318	0.5402	0.7373	0.5402	0.7350
No log	5.2459	320	0.5323	0.7425	0.5323	0.7296
No log	5.2787	322	0.5447	0.7230	0.5447	0.7380
No log	5.3115	324	0.5476	0.7237	0.5476	0.7400
No log	5.3443	326	0.5335	0.7443	0.5335	0.7304
No log	5.3770	328	0.5506	0.7433	0.5506	0.7420
No log	5.4098	330	0.6011	0.7663	0.6011	0.7753
No log	5.4426	332	0.6437	0.7250	0.6437	0.8023
No log	5.4754	334	0.6612	0.7142	0.6612	0.8132
No log	5.5082	336	0.6119	0.7238	0.6119	0.7823
No log	5.5410	338	0.5575	0.7327	0.5575	0.7467
No log	5.5738	340	0.5569	0.7241	0.5569	0.7462
No log	5.6066	342	0.5810	0.6965	0.5810	0.7622
No log	5.6393	344	0.5865	0.6893	0.5865	0.7659
No log	5.6721	346	0.5639	0.7036	0.5639	0.7509
No log	5.7049	348	0.5420	0.7190	0.5420	0.7362
No log	5.7377	350	0.5735	0.7288	0.5735	0.7573
No log	5.7705	352	0.5992	0.7046	0.5992	0.7741
No log	5.8033	354	0.5826	0.7306	0.5826	0.7633
No log	5.8361	356	0.5709	0.7312	0.5709	0.7556
No log	5.8689	358	0.5571	0.7431	0.5571	0.7464
No log	5.9016	360	0.5414	0.7176	0.5414	0.7358
No log	5.9344	362	0.5500	0.7207	0.5500	0.7416
No log	5.9672	364	0.5522	0.6964	0.5522	0.7431
No log	6.0	366	0.5428	0.7157	0.5428	0.7368
No log	6.0328	368	0.5446	0.7332	0.5446	0.7380
No log	6.0656	370	0.5744	0.7378	0.5744	0.7579
No log	6.0984	372	0.6120	0.7186	0.6120	0.7823
No log	6.1311	374	0.6127	0.7186	0.6127	0.7827
No log	6.1639	376	0.5867	0.7397	0.5867	0.7660
No log	6.1967	378	0.5738	0.7450	0.5738	0.7575
No log	6.2295	380	0.5681	0.7408	0.5681	0.7537
No log	6.2623	382	0.5805	0.7306	0.5805	0.7619
No log	6.2951	384	0.5775	0.7306	0.5775	0.7599
No log	6.3279	386	0.6027	0.7447	0.6027	0.7764
No log	6.3607	388	0.6552	0.7073	0.6552	0.8095
No log	6.3934	390	0.7179	0.6682	0.7179	0.8473
No log	6.4262	392	0.7471	0.6582	0.7471	0.8643
No log	6.4590	394	0.7611	0.6460	0.7611	0.8724
No log	6.4918	396	0.7558	0.6460	0.7558	0.8694
No log	6.5246	398	0.7052	0.6674	0.7052	0.8398
No log	6.5574	400	0.6349	0.7090	0.6349	0.7968
No log	6.5902	402	0.5819	0.7471	0.5819	0.7628
No log	6.6230	404	0.5560	0.7164	0.5560	0.7457
No log	6.6557	406	0.5461	0.7240	0.5461	0.7390
No log	6.6885	408	0.5410	0.7314	0.5410	0.7356
No log	6.7213	410	0.5394	0.7509	0.5394	0.7344
No log	6.7541	412	0.5421	0.7509	0.5421	0.7362
No log	6.7869	414	0.5519	0.7385	0.5519	0.7429
No log	6.8197	416	0.5507	0.7360	0.5507	0.7421
No log	6.8525	418	0.5358	0.7509	0.5358	0.7320
No log	6.8852	420	0.5225	0.7537	0.5225	0.7228
No log	6.9180	422	0.5219	0.7584	0.5219	0.7224
No log	6.9508	424	0.5232	0.7521	0.5232	0.7233
No log	6.9836	426	0.5291	0.7441	0.5291	0.7274
No log	7.0164	428	0.5335	0.7211	0.5335	0.7304
No log	7.0492	430	0.5358	0.7477	0.5358	0.7320
No log	7.0820	432	0.5363	0.7477	0.5363	0.7323
No log	7.1148	434	0.5370	0.7519	0.5370	0.7328
No log	7.1475	436	0.5400	0.7314	0.5400	0.7348
No log	7.1803	438	0.5451	0.7109	0.5451	0.7383
No log	7.2131	440	0.5494	0.7039	0.5494	0.7412
No log	7.2459	442	0.5474	0.7136	0.5474	0.7398
No log	7.2787	444	0.5441	0.7471	0.5441	0.7377
No log	7.3115	446	0.5477	0.7593	0.5477	0.7401
No log	7.3443	448	0.5632	0.7520	0.5632	0.7505
No log	7.3770	450	0.5674	0.7495	0.5674	0.7533
No log	7.4098	452	0.5601	0.7541	0.5601	0.7484
No log	7.4426	454	0.5503	0.7567	0.5503	0.7418
No log	7.4754	456	0.5393	0.7728	0.5393	0.7344
No log	7.5082	458	0.5396	0.7461	0.5396	0.7346
No log	7.5410	460	0.5400	0.7561	0.5400	0.7349
No log	7.5738	462	0.5385	0.7501	0.5385	0.7339
No log	7.6066	464	0.5374	0.7508	0.5374	0.7331
No log	7.6393	466	0.5364	0.7478	0.5364	0.7324
No log	7.6721	468	0.5347	0.7646	0.5347	0.7312
No log	7.7049	470	0.5347	0.7646	0.5347	0.7312
No log	7.7377	472	0.5341	0.7646	0.5341	0.7308
No log	7.7705	474	0.5367	0.7620	0.5367	0.7326
No log	7.8033	476	0.5498	0.7603	0.5498	0.7415
No log	7.8361	478	0.5751	0.7553	0.5751	0.7583
No log	7.8689	480	0.5837	0.7553	0.5837	0.7640
No log	7.9016	482	0.5698	0.7553	0.5698	0.7549
No log	7.9344	484	0.5476	0.7500	0.5476	0.7400
No log	7.9672	486	0.5373	0.7687	0.5373	0.7330
No log	8.0	488	0.5333	0.7543	0.5333	0.7303
No log	8.0328	490	0.5321	0.7543	0.5321	0.7294
No log	8.0656	492	0.5320	0.7543	0.5320	0.7294
No log	8.0984	494	0.5339	0.7508	0.5339	0.7307
No log	8.1311	496	0.5345	0.7570	0.5345	0.7311
No log	8.1639	498	0.5347	0.7524	0.5347	0.7312
0.4109	8.1967	500	0.5380	0.7543	0.5380	0.7335
0.4109	8.2295	502	0.5429	0.7646	0.5429	0.7368
0.4109	8.2623	504	0.5468	0.7484	0.5468	0.7395
0.4109	8.2951	506	0.5541	0.7500	0.5541	0.7444
0.4109	8.3279	508	0.5561	0.7500	0.5561	0.7457
0.4109	8.3607	510	0.5529	0.7500	0.5529	0.7436
0.4109	8.3934	512	0.5531	0.7528	0.5531	0.7437
0.4109	8.4262	514	0.5533	0.7595	0.5533	0.7438
0.4109	8.4590	516	0.5624	0.7630	0.5624	0.7499
0.4109	8.4918	518	0.5643	0.7630	0.5643	0.7512
0.4109	8.5246	520	0.5621	0.7695	0.5621	0.7498
0.4109	8.5574	522	0.5603	0.7695	0.5603	0.7486
0.4109	8.5902	524	0.5578	0.7695	0.5578	0.7469
0.4109	8.6230	526	0.5641	0.7563	0.5641	0.7511
0.4109	8.6557	528	0.5707	0.7538	0.5707	0.7555
0.4109	8.6885	530	0.5722	0.7538	0.5722	0.7564
0.4109	8.7213	532	0.5685	0.7538	0.5685	0.7540
0.4109	8.7541	534	0.5625	0.7538	0.5625	0.7500
0.4109	8.7869	536	0.5538	0.7522	0.5538	0.7442
0.4109	8.8197	538	0.5507	0.7522	0.5507	0.7421
0.4109	8.8525	540	0.5470	0.7547	0.5470	0.7396
0.4109	8.8852	542	0.5470	0.7547	0.5470	0.7396
0.4109	8.9180	544	0.5464	0.7547	0.5464	0.7392
0.4109	8.9508	546	0.5498	0.7547	0.5498	0.7415
0.4109	8.9836	548	0.5555	0.7538	0.5555	0.7453
0.4109	9.0164	550	0.5596	0.7538	0.5596	0.7480
0.4109	9.0492	552	0.5631	0.7538	0.5631	0.7504
0.4109	9.0820	554	0.5715	0.7399	0.5715	0.7559
0.4109	9.1148	556	0.5829	0.7461	0.5829	0.7635
0.4109	9.1475	558	0.5894	0.7461	0.5894	0.7677
0.4109	9.1803	560	0.5946	0.7523	0.5946	0.7711
0.4109	9.2131	562	0.5911	0.7461	0.5911	0.7689
0.4109	9.2459	564	0.5843	0.7399	0.5843	0.7644
0.4109	9.2787	566	0.5744	0.7399	0.5744	0.7579
0.4109	9.3115	568	0.5664	0.7383	0.5664	0.7526
0.4109	9.3443	570	0.5624	0.7429	0.5624	0.7500
0.4109	9.3770	572	0.5608	0.7429	0.5608	0.7489
0.4109	9.4098	574	0.5601	0.7429	0.5601	0.7484
0.4109	9.4426	576	0.5617	0.7429	0.5617	0.7495
0.4109	9.4754	578	0.5665	0.7359	0.5665	0.7527
0.4109	9.5082	580	0.5734	0.7399	0.5734	0.7573
0.4109	9.5410	582	0.5779	0.7399	0.5779	0.7602
0.4109	9.5738	584	0.5826	0.7399	0.5826	0.7633
0.4109	9.6066	586	0.5852	0.7399	0.5852	0.7650
0.4109	9.6393	588	0.5864	0.7399	0.5864	0.7658
0.4109	9.6721	590	0.5892	0.7502	0.5892	0.7676
0.4109	9.7049	592	0.5894	0.7502	0.5894	0.7677
0.4109	9.7377	594	0.5899	0.7502	0.5899	0.7680
0.4109	9.7705	596	0.5892	0.7502	0.5892	0.7676
0.4109	9.8033	598	0.5875	0.7439	0.5875	0.7665
0.4109	9.8361	600	0.5861	0.7439	0.5861	0.7655
0.4109	9.8689	602	0.5844	0.7439	0.5844	0.7645
0.4109	9.9016	604	0.5828	0.7399	0.5828	0.7634
0.4109	9.9344	606	0.5820	0.7399	0.5820	0.7629
0.4109	9.9672	608	0.5814	0.7399	0.5814	0.7625
0.4109	10.0	610	0.5810	0.7399	0.5810	0.7623

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1