ArabicNewSplits6_FineTuningAraBERT_run3_AugV5_k17_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9045
• Qwk: 0.6422
• Mse: 0.9045
• Rmse: 0.9510

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0323	2	2.3150	0.0239	2.3150	1.5215
No log	0.0645	4	1.5607	0.1391	1.5607	1.2493
No log	0.0968	6	1.6618	0.0315	1.6618	1.2891
No log	0.1290	8	1.5281	0.0731	1.5281	1.2362
No log	0.1613	10	1.4802	0.0793	1.4802	1.2167
No log	0.1935	12	1.4639	0.1093	1.4639	1.2099
No log	0.2258	14	1.4566	0.1170	1.4566	1.2069
No log	0.2581	16	1.4370	0.1523	1.4370	1.1987
No log	0.2903	18	1.5754	0.2111	1.5754	1.2551
No log	0.3226	20	1.8284	0.2913	1.8284	1.3522
No log	0.3548	22	1.7838	0.1620	1.7838	1.3356
No log	0.3871	24	1.7183	0.0710	1.7183	1.3108
No log	0.4194	26	1.6051	0.2040	1.6051	1.2669
No log	0.4516	28	1.5638	0.2668	1.5638	1.2505
No log	0.4839	30	1.4973	0.2772	1.4973	1.2236
No log	0.5161	32	1.4863	0.3069	1.4863	1.2191
No log	0.5484	34	1.4044	0.2153	1.4044	1.1851
No log	0.5806	36	1.3333	0.2558	1.3333	1.1547
No log	0.6129	38	1.3102	0.2134	1.3102	1.1446
No log	0.6452	40	1.3778	0.2644	1.3778	1.1738
No log	0.6774	42	1.4331	0.2137	1.4331	1.1971
No log	0.7097	44	1.5458	0.1280	1.5458	1.2433
No log	0.7419	46	1.5178	0.1478	1.5178	1.2320
No log	0.7742	48	1.3758	0.1899	1.3758	1.1729
No log	0.8065	50	1.3004	0.1920	1.3004	1.1404
No log	0.8387	52	1.2798	0.1467	1.2798	1.1313
No log	0.8710	54	1.2908	0.1399	1.2908	1.1361
No log	0.9032	56	1.3229	0.1963	1.3229	1.1502
No log	0.9355	58	1.3985	0.2797	1.3985	1.1826
No log	0.9677	60	1.4889	0.3997	1.4889	1.2202
No log	1.0	62	1.5022	0.3807	1.5022	1.2256
No log	1.0323	64	1.3151	0.2718	1.3151	1.1468
No log	1.0645	66	1.1991	0.2389	1.1991	1.0950
No log	1.0968	68	1.1934	0.3006	1.1934	1.0924
No log	1.1290	70	1.2784	0.3705	1.2784	1.1307
No log	1.1613	72	1.2850	0.3956	1.2850	1.1336
No log	1.1935	74	1.2018	0.3607	1.2018	1.0963
No log	1.2258	76	1.1103	0.4084	1.1103	1.0537
No log	1.2581	78	1.0859	0.4218	1.0859	1.0420
No log	1.2903	80	1.1305	0.4861	1.1305	1.0632
No log	1.3226	82	1.2148	0.4270	1.2148	1.1022
No log	1.3548	84	1.2352	0.4552	1.2352	1.1114
No log	1.3871	86	1.1827	0.4331	1.1827	1.0875
No log	1.4194	88	1.1786	0.4191	1.1786	1.0856
No log	1.4516	90	1.2564	0.3989	1.2564	1.1209
No log	1.4839	92	1.4285	0.4087	1.4285	1.1952
No log	1.5161	94	1.3825	0.4218	1.3825	1.1758
No log	1.5484	96	1.1430	0.5038	1.1430	1.0691
No log	1.5806	98	1.2001	0.4393	1.2001	1.0955
No log	1.6129	100	1.2479	0.4278	1.2479	1.1171
No log	1.6452	102	1.2286	0.4424	1.2286	1.1084
No log	1.6774	104	1.2485	0.4576	1.2485	1.1174
No log	1.7097	106	1.2188	0.4864	1.2188	1.1040
No log	1.7419	108	1.0626	0.4692	1.0626	1.0308
No log	1.7742	110	1.0006	0.4964	1.0006	1.0003
No log	1.8065	112	1.0292	0.4975	1.0292	1.0145
No log	1.8387	114	0.9980	0.4572	0.9980	0.9990
No log	1.8710	116	1.0762	0.5117	1.0762	1.0374
No log	1.9032	118	0.9760	0.5313	0.9760	0.9879
No log	1.9355	120	0.9398	0.5348	0.9398	0.9695
No log	1.9677	122	0.9767	0.5345	0.9767	0.9883
No log	2.0	124	0.9713	0.5430	0.9713	0.9855
No log	2.0323	126	1.0489	0.5227	1.0489	1.0241
No log	2.0645	128	1.2269	0.5445	1.2269	1.1076
No log	2.0968	130	1.3511	0.4996	1.3511	1.1624
No log	2.1290	132	1.3097	0.5020	1.3097	1.1444
No log	2.1613	134	1.0763	0.5517	1.0763	1.0375
No log	2.1935	136	0.9689	0.5487	0.9689	0.9843
No log	2.2258	138	1.0301	0.5422	1.0301	1.0150
No log	2.2581	140	1.2896	0.5415	1.2896	1.1356
No log	2.2903	142	1.7728	0.4210	1.7728	1.3315
No log	2.3226	144	1.8100	0.3951	1.8100	1.3454
No log	2.3548	146	1.3786	0.5070	1.3786	1.1741
No log	2.3871	148	1.2317	0.5758	1.2317	1.1098
No log	2.4194	150	1.3951	0.4974	1.3951	1.1811
No log	2.4516	152	1.3516	0.5060	1.3516	1.1626
No log	2.4839	154	1.1473	0.5267	1.1473	1.0711
No log	2.5161	156	1.0433	0.5517	1.0433	1.0214
No log	2.5484	158	0.9887	0.5414	0.9887	0.9943
No log	2.5806	160	0.9698	0.5577	0.9698	0.9848
No log	2.6129	162	1.1044	0.5137	1.1044	1.0509
No log	2.6452	164	1.2890	0.5061	1.2890	1.1354
No log	2.6774	166	1.4643	0.4616	1.4643	1.2101
No log	2.7097	168	1.3217	0.5146	1.3217	1.1497
No log	2.7419	170	1.0694	0.5512	1.0694	1.0341
No log	2.7742	172	0.8909	0.6143	0.8909	0.9439
No log	2.8065	174	0.8992	0.5817	0.8992	0.9483
No log	2.8387	176	1.1099	0.5573	1.1099	1.0535
No log	2.8710	178	1.4382	0.5215	1.4382	1.1993
No log	2.9032	180	1.3913	0.5282	1.3913	1.1795
No log	2.9355	182	1.3014	0.5362	1.3014	1.1408
No log	2.9677	184	1.1033	0.5533	1.1033	1.0504
No log	3.0	186	0.9975	0.5550	0.9975	0.9987
No log	3.0323	188	0.8870	0.5624	0.8870	0.9418
No log	3.0645	190	0.9890	0.5443	0.9890	0.9945
No log	3.0968	192	1.0359	0.5473	1.0359	1.0178
No log	3.1290	194	0.9673	0.5721	0.9673	0.9835
No log	3.1613	196	1.0214	0.5928	1.0214	1.0107
No log	3.1935	198	1.1324	0.5895	1.1324	1.0641
No log	3.2258	200	1.0746	0.6019	1.0746	1.0366
No log	3.2581	202	0.9001	0.6420	0.9001	0.9487
No log	3.2903	204	0.9062	0.6124	0.9062	0.9520
No log	3.3226	206	0.9973	0.5757	0.9973	0.9986
No log	3.3548	208	1.1217	0.5856	1.1217	1.0591
No log	3.3871	210	1.1111	0.5713	1.1111	1.0541
No log	3.4194	212	0.9676	0.5925	0.9676	0.9837
No log	3.4516	214	0.8779	0.6198	0.8779	0.9370
No log	3.4839	216	0.8985	0.6120	0.8985	0.9479
No log	3.5161	218	1.0935	0.5976	1.0935	1.0457
No log	3.5484	220	1.3444	0.4988	1.3444	1.1595
No log	3.5806	222	1.5607	0.4710	1.5607	1.2493
No log	3.6129	224	1.7397	0.4553	1.7397	1.3190
No log	3.6452	226	1.6761	0.4525	1.6761	1.2946
No log	3.6774	228	1.4565	0.4794	1.4565	1.2068
No log	3.7097	230	1.3256	0.5356	1.3256	1.1514
No log	3.7419	232	1.4257	0.5429	1.4257	1.1940
No log	3.7742	234	1.5152	0.4971	1.5152	1.2309
No log	3.8065	236	1.5293	0.5003	1.5293	1.2366
No log	3.8387	238	1.2938	0.5554	1.2938	1.1374
No log	3.8710	240	1.0687	0.6062	1.0687	1.0338
No log	3.9032	242	0.9752	0.6190	0.9752	0.9875
No log	3.9355	244	0.9452	0.6571	0.9452	0.9722
No log	3.9677	246	0.9615	0.6280	0.9615	0.9806
No log	4.0	248	1.0639	0.6079	1.0639	1.0314
No log	4.0323	250	1.1250	0.6086	1.1250	1.0607
No log	4.0645	252	1.0564	0.5907	1.0564	1.0278
No log	4.0968	254	0.8747	0.6014	0.8747	0.9353
No log	4.1290	256	0.7610	0.6591	0.7610	0.8723
No log	4.1613	258	0.7587	0.6591	0.7587	0.8710
No log	4.1935	260	0.8248	0.6538	0.8248	0.9082
No log	4.2258	262	1.0676	0.5746	1.0676	1.0332
No log	4.2581	264	1.4352	0.5215	1.4352	1.1980
No log	4.2903	266	1.5082	0.5019	1.5082	1.2281
No log	4.3226	268	1.3228	0.5374	1.3228	1.1501
No log	4.3548	270	1.0299	0.5746	1.0299	1.0148
No log	4.3871	272	0.8093	0.6542	0.8093	0.8996
No log	4.4194	274	0.7492	0.6904	0.7492	0.8656
No log	4.4516	276	0.7440	0.6934	0.7440	0.8625
No log	4.4839	278	0.7933	0.6511	0.7933	0.8907
No log	4.5161	280	1.0000	0.5975	1.0000	1.0000
No log	4.5484	282	1.2228	0.5435	1.2228	1.1058
No log	4.5806	284	1.2875	0.5252	1.2875	1.1347
No log	4.6129	286	1.1982	0.5435	1.1982	1.0946
No log	4.6452	288	1.0847	0.5679	1.0847	1.0415
No log	4.6774	290	1.0680	0.5677	1.0680	1.0335
No log	4.7097	292	1.0643	0.5677	1.0643	1.0316
No log	4.7419	294	1.0792	0.5804	1.0792	1.0389
No log	4.7742	296	1.1091	0.5825	1.1091	1.0532
No log	4.8065	298	1.1146	0.5779	1.1146	1.0557
No log	4.8387	300	1.0095	0.6160	1.0095	1.0047
No log	4.8710	302	0.9720	0.6232	0.9720	0.9859
No log	4.9032	304	1.0300	0.5899	1.0300	1.0149
No log	4.9355	306	0.9950	0.5899	0.9950	0.9975
No log	4.9677	308	1.0202	0.5963	1.0202	1.0101
No log	5.0	310	1.0640	0.5853	1.0640	1.0315
No log	5.0323	312	1.1253	0.5540	1.1253	1.0608
No log	5.0645	314	1.0848	0.5629	1.0848	1.0416
No log	5.0968	316	0.9471	0.6292	0.9471	0.9732
No log	5.1290	318	0.8871	0.6396	0.8871	0.9419
No log	5.1613	320	0.8664	0.6456	0.8664	0.9308
No log	5.1935	322	0.8821	0.6520	0.8821	0.9392
No log	5.2258	324	0.9677	0.6230	0.9677	0.9837
No log	5.2581	326	0.9925	0.6230	0.9925	0.9963
No log	5.2903	328	1.0623	0.6250	1.0623	1.0307
No log	5.3226	330	1.0225	0.6203	1.0225	1.0112
No log	5.3548	332	0.9279	0.6363	0.9279	0.9633
No log	5.3871	334	0.8686	0.6353	0.8686	0.9320
No log	5.4194	336	0.8454	0.6218	0.8454	0.9194
No log	5.4516	338	0.8656	0.6447	0.8656	0.9304
No log	5.4839	340	0.9282	0.6132	0.9282	0.9634
No log	5.5161	342	0.9333	0.6149	0.9333	0.9661
No log	5.5484	344	0.8799	0.6301	0.8799	0.9380
No log	5.5806	346	0.8938	0.6396	0.8938	0.9454
No log	5.6129	348	0.9276	0.6114	0.9276	0.9631
No log	5.6452	350	1.0262	0.6022	1.0262	1.0130
No log	5.6774	352	1.0517	0.5963	1.0517	1.0255
No log	5.7097	354	1.1101	0.5843	1.1101	1.0536
No log	5.7419	356	1.2031	0.5705	1.2031	1.0969
No log	5.7742	358	1.2362	0.5531	1.2362	1.1119
No log	5.8065	360	1.1526	0.5832	1.1526	1.0736
No log	5.8387	362	1.1155	0.5768	1.1155	1.0562
No log	5.8710	364	1.1722	0.5641	1.1722	1.0827
No log	5.9032	366	1.2891	0.5290	1.2891	1.1354
No log	5.9355	368	1.4405	0.5036	1.4405	1.2002
No log	5.9677	370	1.4498	0.4951	1.4498	1.2041
No log	6.0	372	1.3284	0.5354	1.3284	1.1526
No log	6.0323	374	1.1480	0.5684	1.1480	1.0715
No log	6.0645	376	1.0460	0.6000	1.0460	1.0227
No log	6.0968	378	1.0207	0.6000	1.0207	1.0103
No log	6.1290	380	1.0618	0.5930	1.0618	1.0304
No log	6.1613	382	1.1388	0.5779	1.1388	1.0671
No log	6.1935	384	1.2396	0.5767	1.2396	1.1134
No log	6.2258	386	1.2564	0.5757	1.2564	1.1209
No log	6.2581	388	1.1477	0.5890	1.1477	1.0713
No log	6.2903	390	0.9524	0.6095	0.9524	0.9759
No log	6.3226	392	0.8472	0.6733	0.8472	0.9205
No log	6.3548	394	0.8563	0.6550	0.8563	0.9254
No log	6.3871	396	0.8895	0.6491	0.8895	0.9431
No log	6.4194	398	0.9848	0.5921	0.9848	0.9924
No log	6.4516	400	1.0207	0.5823	1.0207	1.0103
No log	6.4839	402	1.0220	0.5960	1.0220	1.0110
No log	6.5161	404	0.9610	0.6009	0.9610	0.9803
No log	6.5484	406	0.8503	0.6534	0.8503	0.9221
No log	6.5806	408	0.8406	0.6655	0.8406	0.9168
No log	6.6129	410	0.8581	0.6363	0.8581	0.9263
No log	6.6452	412	0.9324	0.6185	0.9324	0.9656
No log	6.6774	414	0.9752	0.6048	0.9752	0.9875
No log	6.7097	416	0.9931	0.5960	0.9931	0.9965
No log	6.7419	418	0.9867	0.6048	0.9867	0.9933
No log	6.7742	420	0.9644	0.6090	0.9644	0.9820
No log	6.8065	422	0.9355	0.6009	0.9355	0.9672
No log	6.8387	424	0.9285	0.6099	0.9285	0.9636
No log	6.8710	426	0.9097	0.6185	0.9097	0.9538
No log	6.9032	428	0.8645	0.6393	0.8645	0.9298
No log	6.9355	430	0.8640	0.6306	0.8640	0.9295
No log	6.9677	432	0.9324	0.6099	0.9324	0.9656
No log	7.0	434	1.0792	0.5832	1.0792	1.0388
No log	7.0323	436	1.1469	0.5666	1.1469	1.0709
No log	7.0645	438	1.1080	0.5852	1.1080	1.0526
No log	7.0968	440	1.0142	0.6035	1.0142	1.0071
No log	7.1290	442	0.9180	0.5985	0.9180	0.9581
No log	7.1613	444	0.9038	0.5985	0.9038	0.9507
No log	7.1935	446	0.9405	0.6116	0.9405	0.9698
No log	7.2258	448	1.0514	0.5905	1.0514	1.0254
No log	7.2581	450	1.1791	0.5717	1.1791	1.0859
No log	7.2903	452	1.1921	0.5787	1.1921	1.0918
No log	7.3226	454	1.1476	0.5948	1.1476	1.0713
No log	7.3548	456	1.0718	0.6125	1.0718	1.0353
No log	7.3871	458	1.0366	0.6032	1.0366	1.0181
No log	7.4194	460	1.0419	0.5946	1.0419	1.0207
No log	7.4516	462	1.0402	0.5916	1.0402	1.0199
No log	7.4839	464	1.0562	0.5843	1.0562	1.0277
No log	7.5161	466	1.0997	0.5925	1.0997	1.0487
No log	7.5484	468	1.0921	0.5769	1.0921	1.0450
No log	7.5806	470	1.0258	0.5546	1.0258	1.0128
No log	7.6129	472	0.9844	0.5585	0.9844	0.9921
No log	7.6452	474	0.9163	0.5613	0.9163	0.9572
No log	7.6774	476	0.8868	0.5796	0.8868	0.9417
No log	7.7097	478	0.9106	0.5721	0.9106	0.9542
No log	7.7419	480	0.9334	0.5746	0.9334	0.9661
No log	7.7742	482	0.9763	0.5656	0.9763	0.9881
No log	7.8065	484	0.9695	0.5702	0.9695	0.9846
No log	7.8387	486	0.9056	0.6132	0.9056	0.9517
No log	7.8710	488	0.8593	0.6590	0.8593	0.9270
No log	7.9032	490	0.8336	0.6625	0.8336	0.9130
No log	7.9355	492	0.8202	0.6531	0.8202	0.9057
No log	7.9677	494	0.8524	0.6590	0.8524	0.9232
No log	8.0	496	0.8959	0.6510	0.8959	0.9465
No log	8.0323	498	0.9225	0.6581	0.9225	0.9605
0.3666	8.0645	500	0.9183	0.6581	0.9183	0.9583
0.3666	8.0968	502	0.9315	0.6581	0.9315	0.9651
0.3666	8.1290	504	0.9483	0.6475	0.9483	0.9738
0.3666	8.1613	506	0.9469	0.6413	0.9469	0.9731
0.3666	8.1935	508	0.9708	0.6454	0.9708	0.9853
0.3666	8.2258	510	0.9794	0.6340	0.9794	0.9897
0.3666	8.2581	512	0.9709	0.6367	0.9709	0.9853
0.3666	8.2903	514	0.9265	0.6517	0.9265	0.9625
0.3666	8.3226	516	0.8973	0.6622	0.8973	0.9473
0.3666	8.3548	518	0.8760	0.6537	0.8760	0.9359
0.3666	8.3871	520	0.8549	0.6938	0.8549	0.9246
0.3666	8.4194	522	0.8582	0.6938	0.8582	0.9264
0.3666	8.4516	524	0.8876	0.6622	0.8876	0.9421
0.3666	8.4839	526	0.9137	0.6416	0.9137	0.9559
0.3666	8.5161	528	0.9337	0.6258	0.9337	0.9663
0.3666	8.5484	530	0.9178	0.6300	0.9178	0.9580
0.3666	8.5806	532	0.8798	0.6714	0.8798	0.9380
0.3666	8.6129	534	0.8373	0.6794	0.8373	0.9150
0.3666	8.6452	536	0.8070	0.6960	0.8070	0.8983
0.3666	8.6774	538	0.8085	0.6916	0.8085	0.8992
0.3666	8.7097	540	0.8378	0.6794	0.8378	0.9153
0.3666	8.7419	542	0.8747	0.6587	0.8747	0.9352
0.3666	8.7742	544	0.8919	0.6468	0.8919	0.9444
0.3666	8.8065	546	0.9118	0.6555	0.9118	0.9549
0.3666	8.8387	548	0.9555	0.6157	0.9555	0.9775
0.3666	8.8710	550	1.0021	0.6087	1.0021	1.0010
0.3666	8.9032	552	1.0184	0.5993	1.0184	1.0092
0.3666	8.9355	554	1.0246	0.5982	1.0246	1.0122
0.3666	8.9677	556	1.0002	0.6232	1.0002	1.0001
0.3666	9.0	558	0.9746	0.6172	0.9746	0.9872
0.3666	9.0323	560	0.9409	0.6231	0.9409	0.9700
0.3666	9.0645	562	0.9168	0.6446	0.9168	0.9575
0.3666	9.0968	564	0.9064	0.6446	0.9064	0.9520
0.3666	9.1290	566	0.9047	0.6446	0.9047	0.9512
0.3666	9.1613	568	0.8940	0.6537	0.8940	0.9455
0.3666	9.1935	570	0.8913	0.6537	0.8913	0.9441
0.3666	9.2258	572	0.8877	0.6537	0.8877	0.9422
0.3666	9.2581	574	0.8920	0.6537	0.8920	0.9445
0.3666	9.2903	576	0.9093	0.6537	0.9093	0.9536
0.3666	9.3226	578	0.9385	0.6258	0.9385	0.9688
0.3666	9.3548	580	0.9611	0.6258	0.9611	0.9804
0.3666	9.3871	582	0.9732	0.6141	0.9732	0.9865
0.3666	9.4194	584	0.9744	0.6141	0.9744	0.9871
0.3666	9.4516	586	0.9633	0.6258	0.9633	0.9815
0.3666	9.4839	588	0.9421	0.6346	0.9421	0.9706
0.3666	9.5161	590	0.9245	0.6422	0.9245	0.9615
0.3666	9.5484	592	0.9138	0.6422	0.9138	0.9559
0.3666	9.5806	594	0.9070	0.6422	0.9070	0.9524
0.3666	9.6129	596	0.9032	0.6464	0.9032	0.9504
0.3666	9.6452	598	0.9072	0.6422	0.9072	0.9525
0.3666	9.6774	600	0.9137	0.6422	0.9137	0.9559
0.3666	9.7097	602	0.9214	0.6422	0.9214	0.9599
0.3666	9.7419	604	0.9239	0.6422	0.9239	0.9612
0.3666	9.7742	606	0.9234	0.6422	0.9234	0.9609
0.3666	9.8065	608	0.9241	0.6422	0.9241	0.9613
0.3666	9.8387	610	0.9210	0.6422	0.9210	0.9597
0.3666	9.8710	612	0.9164	0.6422	0.9164	0.9573
0.3666	9.9032	614	0.9113	0.6422	0.9113	0.9546
0.3666	9.9355	616	0.9073	0.6422	0.9073	0.9525
0.3666	9.9677	618	0.9051	0.6422	0.9051	0.9514
0.3666	10.0	620	0.9045	0.6422	0.9045	0.9510

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1