ArabicNewSplits5_FineTuningAraBERT_run1_AugV5_k12_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9365
• Qwk: 0.6179
• Mse: 0.9365
• Rmse: 0.9677

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0345	2	2.1899	-0.0074	2.1899	1.4798
No log	0.0690	4	1.8683	0.0233	1.8683	1.3669
No log	0.1034	6	2.2425	-0.0945	2.2425	1.4975
No log	0.1379	8	1.6998	0.0643	1.6998	1.3038
No log	0.1724	10	1.4406	0.1243	1.4406	1.2002
No log	0.2069	12	1.3859	0.1174	1.3859	1.1772
No log	0.2414	14	1.4194	0.3151	1.4194	1.1914
No log	0.2759	16	1.3819	0.2910	1.3819	1.1756
No log	0.3103	18	1.2983	0.2075	1.2983	1.1394
No log	0.3448	20	1.2794	0.1999	1.2794	1.1311
No log	0.3793	22	1.2589	0.2955	1.2589	1.1220
No log	0.4138	24	1.2931	0.3369	1.2931	1.1372
No log	0.4483	26	1.4068	0.3190	1.4068	1.1861
No log	0.4828	28	1.4125	0.2750	1.4125	1.1885
No log	0.5172	30	1.3076	0.3444	1.3076	1.1435
No log	0.5517	32	1.1780	0.3562	1.1780	1.0853
No log	0.5862	34	1.1755	0.3050	1.1755	1.0842
No log	0.6207	36	1.2360	0.1923	1.2360	1.1118
No log	0.6552	38	1.2729	0.1575	1.2729	1.1282
No log	0.6897	40	1.3011	0.1364	1.3011	1.1406
No log	0.7241	42	1.2843	0.1128	1.2843	1.1333
No log	0.7586	44	1.2497	0.1983	1.2497	1.1179
No log	0.7931	46	1.1883	0.2715	1.1883	1.0901
No log	0.8276	48	1.1438	0.2852	1.1438	1.0695
No log	0.8621	50	1.1068	0.3601	1.1068	1.0520
No log	0.8966	52	1.0911	0.4148	1.0911	1.0446
No log	0.9310	54	1.1061	0.4327	1.1061	1.0517
No log	0.9655	56	1.2012	0.4166	1.2012	1.0960
No log	1.0	58	1.3264	0.4017	1.3264	1.1517
No log	1.0345	60	1.2811	0.4293	1.2811	1.1319
No log	1.0690	62	1.1405	0.4107	1.1405	1.0680
No log	1.1034	64	1.0954	0.3735	1.0954	1.0466
No log	1.1379	66	1.0560	0.4797	1.0560	1.0276
No log	1.1724	68	1.0280	0.4787	1.0280	1.0139
No log	1.2069	70	1.0402	0.4811	1.0402	1.0199
No log	1.2414	72	1.0916	0.4703	1.0916	1.0448
No log	1.2759	74	1.2206	0.3807	1.2206	1.1048
No log	1.3103	76	1.2715	0.4057	1.2715	1.1276
No log	1.3448	78	1.2099	0.4678	1.2099	1.1000
No log	1.3793	80	1.0845	0.4666	1.0845	1.0414
No log	1.4138	82	1.1409	0.5345	1.1409	1.0681
No log	1.4483	84	1.4561	0.4253	1.4561	1.2067
No log	1.4828	86	1.6177	0.3658	1.6177	1.2719
No log	1.5172	88	1.4898	0.3961	1.4898	1.2206
No log	1.5517	90	1.1868	0.4947	1.1868	1.0894
No log	1.5862	92	1.0536	0.4688	1.0536	1.0265
No log	1.6207	94	0.9912	0.5209	0.9912	0.9956
No log	1.6552	96	1.0118	0.4935	1.0118	1.0059
No log	1.6897	98	1.0545	0.5282	1.0545	1.0269
No log	1.7241	100	1.1617	0.5442	1.1617	1.0778
No log	1.7586	102	1.3983	0.4802	1.3983	1.1825
No log	1.7931	104	1.4712	0.4677	1.4712	1.2129
No log	1.8276	106	1.2790	0.5297	1.2790	1.1309
No log	1.8621	108	1.0510	0.5498	1.0510	1.0252
No log	1.8966	110	0.9375	0.5625	0.9375	0.9682
No log	1.9310	112	0.9097	0.5739	0.9097	0.9538
No log	1.9655	114	0.9542	0.6164	0.9542	0.9768
No log	2.0	116	1.1390	0.5642	1.1390	1.0672
No log	2.0345	118	1.1898	0.5502	1.1898	1.0908
No log	2.0690	120	1.0652	0.5828	1.0652	1.0321
No log	2.1034	122	0.9159	0.6164	0.9159	0.9570
No log	2.1379	124	0.8619	0.6127	0.8619	0.9284
No log	2.1724	126	0.8926	0.6172	0.8926	0.9448
No log	2.2069	128	1.0400	0.5998	1.0400	1.0198
No log	2.2414	130	1.2470	0.5415	1.2470	1.1167
No log	2.2759	132	1.3895	0.5232	1.3895	1.1788
No log	2.3103	134	1.2488	0.5346	1.2488	1.1175
No log	2.3448	136	1.0270	0.5969	1.0270	1.0134
No log	2.3793	138	0.9553	0.6003	0.9553	0.9774
No log	2.4138	140	0.9726	0.5912	0.9726	0.9862
No log	2.4483	142	1.0557	0.5779	1.0557	1.0275
No log	2.4828	144	1.1735	0.5889	1.1735	1.0833
No log	2.5172	146	1.2337	0.5606	1.2337	1.1107
No log	2.5517	148	1.1802	0.5690	1.1802	1.0864
No log	2.5862	150	1.1298	0.5901	1.1298	1.0629
No log	2.6207	152	1.1439	0.5789	1.1439	1.0695
No log	2.6552	154	1.1361	0.5734	1.1361	1.0659
No log	2.6897	156	1.0051	0.6420	1.0051	1.0025
No log	2.7241	158	0.9727	0.6278	0.9727	0.9863
No log	2.7586	160	0.9433	0.6329	0.9433	0.9712
No log	2.7931	162	0.8660	0.5891	0.8660	0.9306
No log	2.8276	164	0.8694	0.5983	0.8694	0.9324
No log	2.8621	166	1.0042	0.6117	1.0042	1.0021
No log	2.8966	168	1.1472	0.5394	1.1472	1.0711
No log	2.9310	170	1.5109	0.4996	1.5109	1.2292
No log	2.9655	172	1.6384	0.4675	1.6384	1.2800
No log	3.0	174	1.4066	0.5185	1.4066	1.1860
No log	3.0345	176	1.1749	0.5543	1.1749	1.0839
No log	3.0690	178	1.0274	0.5989	1.0274	1.0136
No log	3.1034	180	1.0514	0.5935	1.0514	1.0254
No log	3.1379	182	1.1139	0.5985	1.1139	1.0554
No log	3.1724	184	1.1208	0.6084	1.1208	1.0587
No log	3.2069	186	1.0525	0.6120	1.0525	1.0259
No log	3.2414	188	0.9657	0.6532	0.9657	0.9827
No log	3.2759	190	0.9919	0.6247	0.9919	0.9959
No log	3.3103	192	1.0102	0.6410	1.0102	1.0051
No log	3.3448	194	1.1319	0.6052	1.1319	1.0639
No log	3.3793	196	1.2961	0.5483	1.2961	1.1384
No log	3.4138	198	1.2333	0.5244	1.2333	1.1105
No log	3.4483	200	1.0457	0.5127	1.0457	1.0226
No log	3.4828	202	0.9613	0.5319	0.9613	0.9805
No log	3.5172	204	0.9583	0.5310	0.9583	0.9789
No log	3.5517	206	1.0712	0.5428	1.0712	1.0350
No log	3.5862	208	1.1968	0.5302	1.1968	1.0940
No log	3.6207	210	1.1994	0.5480	1.1994	1.0952
No log	3.6552	212	1.0892	0.5430	1.0892	1.0436
No log	3.6897	214	0.9056	0.5944	0.9056	0.9516
No log	3.7241	216	0.7937	0.6417	0.7937	0.8909
No log	3.7586	218	0.7703	0.6385	0.7703	0.8777
No log	3.7931	220	0.8127	0.6427	0.8127	0.9015
No log	3.8276	222	0.8932	0.6014	0.8932	0.9451
No log	3.8621	224	0.9878	0.5946	0.9878	0.9939
No log	3.8966	226	1.0362	0.5784	1.0362	1.0180
No log	3.9310	228	1.1552	0.5648	1.1552	1.0748
No log	3.9655	230	1.1126	0.5574	1.1126	1.0548
No log	4.0	232	1.0171	0.5796	1.0171	1.0085
No log	4.0345	234	0.9691	0.5747	0.9691	0.9844
No log	4.0690	236	0.9361	0.5999	0.9361	0.9675
No log	4.1034	238	0.9237	0.6084	0.9237	0.9611
No log	4.1379	240	0.9257	0.5881	0.9257	0.9621
No log	4.1724	242	0.9672	0.5770	0.9672	0.9835
No log	4.2069	244	1.0430	0.5476	1.0430	1.0213
No log	4.2414	246	1.0507	0.5532	1.0507	1.0250
No log	4.2759	248	1.0209	0.5553	1.0209	1.0104
No log	4.3103	250	1.0857	0.5691	1.0857	1.0419
No log	4.3448	252	1.1996	0.5737	1.1996	1.0953
No log	4.3793	254	1.1533	0.5737	1.1533	1.0739
No log	4.4138	256	1.0591	0.5771	1.0591	1.0291
No log	4.4483	258	0.9504	0.5685	0.9504	0.9749
No log	4.4828	260	0.9209	0.5966	0.9209	0.9596
No log	4.5172	262	0.9579	0.5820	0.9579	0.9787
No log	4.5517	264	1.0511	0.5691	1.0511	1.0252
No log	4.5862	266	1.0921	0.5748	1.0921	1.0451
No log	4.6207	268	1.0904	0.5725	1.0904	1.0442
No log	4.6552	270	1.0303	0.5736	1.0303	1.0151
No log	4.6897	272	0.9311	0.6040	0.9311	0.9649
No log	4.7241	274	0.8596	0.6322	0.8596	0.9271
No log	4.7586	276	0.8897	0.6175	0.8897	0.9433
No log	4.7931	278	1.0069	0.5688	1.0069	1.0034
No log	4.8276	280	1.1197	0.5351	1.1197	1.0582
No log	4.8621	282	1.3203	0.5092	1.3203	1.1491
No log	4.8966	284	1.4416	0.5135	1.4416	1.2007
No log	4.9310	286	1.3638	0.5258	1.3638	1.1678
No log	4.9655	288	1.1563	0.5714	1.1563	1.0753
No log	5.0	290	0.9885	0.6077	0.9885	0.9942
No log	5.0345	292	0.8853	0.6146	0.8853	0.9409
No log	5.0690	294	0.8733	0.6133	0.8733	0.9345
No log	5.1034	296	0.9288	0.6229	0.9288	0.9637
No log	5.1379	298	0.9454	0.6068	0.9454	0.9723
No log	5.1724	300	0.9263	0.6068	0.9263	0.9625
No log	5.2069	302	0.9472	0.6068	0.9472	0.9733
No log	5.2414	304	0.9493	0.6147	0.9493	0.9743
No log	5.2759	306	0.9571	0.6147	0.9571	0.9783
No log	5.3103	308	0.9484	0.6130	0.9484	0.9739
No log	5.3448	310	0.9598	0.6097	0.9598	0.9797
No log	5.3793	312	1.0282	0.5872	1.0282	1.0140
No log	5.4138	314	1.1247	0.5814	1.1247	1.0605
No log	5.4483	316	1.1954	0.5715	1.1954	1.0934
No log	5.4828	318	1.1727	0.5648	1.1727	1.0829
No log	5.5172	320	1.1209	0.5746	1.1209	1.0587
No log	5.5517	322	0.9960	0.6250	0.9960	0.9980
No log	5.5862	324	0.8961	0.6306	0.8961	0.9466
No log	5.6207	326	0.8503	0.6347	0.8503	0.9221
No log	5.6552	328	0.8638	0.6316	0.8638	0.9294
No log	5.6897	330	0.9083	0.6217	0.9083	0.9530
No log	5.7241	332	1.0062	0.5757	1.0062	1.0031
No log	5.7586	334	1.1241	0.5487	1.1241	1.0602
No log	5.7931	336	1.1630	0.5581	1.1630	1.0784
No log	5.8276	338	1.1937	0.5409	1.1937	1.0926
No log	5.8621	340	1.1606	0.5503	1.1606	1.0773
No log	5.8966	342	1.0539	0.5860	1.0539	1.0266
No log	5.9310	344	0.9769	0.6068	0.9769	0.9884
No log	5.9655	346	0.9633	0.6083	0.9633	0.9815
No log	6.0	348	0.9973	0.6087	0.9973	0.9986
No log	6.0345	350	1.0120	0.6087	1.0120	1.0060
No log	6.0690	352	0.9651	0.6083	0.9651	0.9824
No log	6.1034	354	0.9463	0.5978	0.9463	0.9728
No log	6.1379	356	0.9100	0.6006	0.9100	0.9539
No log	6.1724	358	0.9179	0.6141	0.9179	0.9580
No log	6.2069	360	0.9647	0.5975	0.9647	0.9822
No log	6.2414	362	0.9646	0.6069	0.9646	0.9822
No log	6.2759	364	0.9324	0.6214	0.9324	0.9656
No log	6.3103	366	0.8753	0.6390	0.8753	0.9356
No log	6.3448	368	0.8244	0.6354	0.8244	0.9080
No log	6.3793	370	0.8242	0.6354	0.8242	0.9078
No log	6.4138	372	0.8763	0.6304	0.8763	0.9361
No log	6.4483	374	0.9562	0.5957	0.9562	0.9779
No log	6.4828	376	1.0936	0.5566	1.0936	1.0458
No log	6.5172	378	1.1548	0.5536	1.1548	1.0746
No log	6.5517	380	1.1336	0.5537	1.1336	1.0647
No log	6.5862	382	1.0794	0.5758	1.0794	1.0390
No log	6.6207	384	1.0550	0.5664	1.0550	1.0271
No log	6.6552	386	1.0677	0.5664	1.0677	1.0333
No log	6.6897	388	1.0522	0.5563	1.0522	1.0258
No log	6.7241	390	1.0727	0.5713	1.0727	1.0357
No log	6.7586	392	1.1249	0.5554	1.1249	1.0606
No log	6.7931	394	1.2061	0.5137	1.2061	1.0982
No log	6.8276	396	1.1796	0.5151	1.1796	1.0861
No log	6.8621	398	1.1379	0.5455	1.1379	1.0667
No log	6.8966	400	1.0627	0.5616	1.0627	1.0309
No log	6.9310	402	0.9818	0.5881	0.9818	0.9909
No log	6.9655	404	0.9574	0.5784	0.9574	0.9785
No log	7.0	406	0.9574	0.5784	0.9574	0.9784
No log	7.0345	408	0.9765	0.5784	0.9765	0.9882
No log	7.0690	410	1.0291	0.5843	1.0291	1.0144
No log	7.1034	412	1.0826	0.5689	1.0826	1.0405
No log	7.1379	414	1.1052	0.5724	1.1052	1.0513
No log	7.1724	416	1.0915	0.5611	1.0915	1.0448
No log	7.2069	418	1.0611	0.5656	1.0611	1.0301
No log	7.2414	420	1.0024	0.5781	1.0024	1.0012
No log	7.2759	422	0.9807	0.5841	0.9807	0.9903
No log	7.3103	424	0.9697	0.5925	0.9697	0.9847
No log	7.3448	426	0.9478	0.6120	0.9478	0.9735
No log	7.3793	428	0.9552	0.6002	0.9552	0.9773
No log	7.4138	430	1.0020	0.5843	1.0020	1.0010
No log	7.4483	432	1.0742	0.5680	1.0742	1.0365
No log	7.4828	434	1.1176	0.5534	1.1176	1.0572
No log	7.5172	436	1.1077	0.5534	1.1077	1.0525
No log	7.5517	438	1.0577	0.5713	1.0577	1.0285
No log	7.5862	440	1.0032	0.5865	1.0032	1.0016
No log	7.6207	442	0.9433	0.6046	0.9433	0.9712
No log	7.6552	444	0.9223	0.6276	0.9223	0.9604
No log	7.6897	446	0.9427	0.6162	0.9427	0.9709
No log	7.7241	448	0.9588	0.6018	0.9588	0.9792
No log	7.7586	450	1.0053	0.5817	1.0053	1.0026
No log	7.7931	452	1.0789	0.5792	1.0789	1.0387
No log	7.8276	454	1.1256	0.5802	1.1256	1.0610
No log	7.8621	456	1.1408	0.5715	1.1408	1.0681
No log	7.8966	458	1.1296	0.5802	1.1296	1.0628
No log	7.9310	460	1.0795	0.5781	1.0795	1.0390
No log	7.9655	462	1.0221	0.5827	1.0221	1.0110
No log	8.0	464	0.9447	0.6051	0.9447	0.9720
No log	8.0345	466	0.9026	0.6444	0.9026	0.9501
No log	8.0690	468	0.9042	0.6444	0.9042	0.9509
No log	8.1034	470	0.9318	0.6179	0.9318	0.9653
No log	8.1379	472	0.9790	0.6069	0.9790	0.9894
No log	8.1724	474	1.0370	0.5815	1.0370	1.0183
No log	8.2069	476	1.0813	0.5770	1.0813	1.0399
No log	8.2414	478	1.1153	0.5604	1.1153	1.0561
No log	8.2759	480	1.1311	0.5628	1.1311	1.0635
No log	8.3103	482	1.1247	0.5628	1.1247	1.0605
No log	8.3448	484	1.0929	0.5781	1.0929	1.0454
No log	8.3793	486	1.0317	0.5905	1.0317	1.0157
No log	8.4138	488	0.9863	0.6056	0.9863	0.9931
No log	8.4483	490	0.9520	0.6115	0.9520	0.9757
No log	8.4828	492	0.9262	0.6240	0.9262	0.9624
No log	8.5172	494	0.9304	0.6240	0.9304	0.9646
No log	8.5517	496	0.9647	0.6069	0.9647	0.9822
No log	8.5862	498	0.9812	0.6011	0.9812	0.9906
0.3087	8.6207	500	1.0059	0.5885	1.0059	1.0030
0.3087	8.6552	502	1.0206	0.5885	1.0206	1.0102
0.3087	8.6897	504	1.0523	0.5848	1.0523	1.0258
0.3087	8.7241	506	1.0639	0.5758	1.0639	1.0315
0.3087	8.7586	508	1.0439	0.5907	1.0439	1.0217
0.3087	8.7931	510	1.0192	0.5839	1.0192	1.0096
0.3087	8.8276	512	0.9775	0.5912	0.9775	0.9887
0.3087	8.8621	514	0.9347	0.5985	0.9347	0.9668
0.3087	8.8966	516	0.9235	0.5985	0.9235	0.9610
0.3087	8.9310	518	0.9346	0.5985	0.9346	0.9667
0.3087	8.9655	520	0.9412	0.5985	0.9412	0.9702
0.3087	9.0	522	0.9473	0.5985	0.9473	0.9733
0.3087	9.0345	524	0.9503	0.5985	0.9503	0.9748
0.3087	9.0690	526	0.9647	0.5971	0.9647	0.9822
0.3087	9.1034	528	0.9841	0.5925	0.9841	0.9920
0.3087	9.1379	530	1.0043	0.6001	1.0043	1.0021
0.3087	9.1724	532	1.0138	0.6001	1.0138	1.0069
0.3087	9.2069	534	1.0217	0.6001	1.0217	1.0108
0.3087	9.2414	536	1.0120	0.6001	1.0120	1.0060
0.3087	9.2759	538	0.9962	0.6001	0.9962	0.9981
0.3087	9.3103	540	0.9767	0.5991	0.9767	0.9883
0.3087	9.3448	542	0.9693	0.6005	0.9693	0.9845
0.3087	9.3793	544	0.9568	0.6005	0.9568	0.9782
0.3087	9.4138	546	0.9486	0.6051	0.9486	0.9739
0.3087	9.4483	548	0.9412	0.6179	0.9412	0.9702
0.3087	9.4828	550	0.9406	0.6179	0.9406	0.9699
0.3087	9.5172	552	0.9380	0.6179	0.9380	0.9685
0.3087	9.5517	554	0.9313	0.6179	0.9313	0.9650
0.3087	9.5862	556	0.9198	0.6179	0.9198	0.9590
0.3087	9.6207	558	0.9165	0.6179	0.9165	0.9574
0.3087	9.6552	560	0.9139	0.6179	0.9139	0.9560
0.3087	9.6897	562	0.9153	0.6225	0.9153	0.9567
0.3087	9.7241	564	0.9199	0.6179	0.9199	0.9591
0.3087	9.7586	566	0.9266	0.6179	0.9266	0.9626
0.3087	9.7931	568	0.9287	0.6179	0.9287	0.9637
0.3087	9.8276	570	0.9311	0.6179	0.9311	0.9649
0.3087	9.8621	572	0.9315	0.6179	0.9315	0.9651
0.3087	9.8966	574	0.9331	0.6179	0.9331	0.9660
0.3087	9.9310	576	0.9344	0.6179	0.9344	0.9667
0.3087	9.9655	578	0.9356	0.6179	0.9356	0.9673
0.3087	10.0	580	0.9365	0.6179	0.9365	0.9677

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1