ArabicNewSplits5_FineTuningAraBERT_run2_AugV5_k12_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8535
• Qwk: 0.6518
• Mse: 0.8535
• Rmse: 0.9238

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0351	2	2.3178	-0.0013	2.3178	1.5224
No log	0.0702	4	1.6379	0.1787	1.6379	1.2798
No log	0.1053	6	1.7637	-0.0044	1.7637	1.3280
No log	0.1404	8	2.0925	-0.0413	2.0925	1.4465
No log	0.1754	10	1.8422	0.0706	1.8422	1.3573
No log	0.2105	12	1.4101	0.1109	1.4101	1.1875
No log	0.2456	14	1.3535	0.1347	1.3535	1.1634
No log	0.2807	16	1.4129	0.1589	1.4129	1.1886
No log	0.3158	18	1.4061	0.1427	1.4061	1.1858
No log	0.3509	20	1.4030	0.1697	1.4030	1.1845
No log	0.3860	22	1.3829	0.1742	1.3829	1.1760
No log	0.4211	24	1.3441	0.1400	1.3441	1.1594
No log	0.4561	26	1.3150	0.1802	1.3150	1.1467
No log	0.4912	28	1.2786	0.1948	1.2786	1.1307
No log	0.5263	30	1.2373	0.2315	1.2373	1.1124
No log	0.5614	32	1.2273	0.2546	1.2273	1.1078
No log	0.5965	34	1.2029	0.2852	1.2029	1.0968
No log	0.6316	36	1.1922	0.2880	1.1922	1.0919
No log	0.6667	38	1.1792	0.3347	1.1792	1.0859
No log	0.7018	40	1.1563	0.3785	1.1563	1.0753
No log	0.7368	42	1.1231	0.3572	1.1231	1.0598
No log	0.7719	44	1.0996	0.4234	1.0996	1.0486
No log	0.8070	46	1.1165	0.4060	1.1165	1.0567
No log	0.8421	48	1.2246	0.4166	1.2246	1.1066
No log	0.8772	50	1.1948	0.4392	1.1948	1.0930
No log	0.9123	52	1.2044	0.4449	1.2044	1.0974
No log	0.9474	54	1.0905	0.5238	1.0905	1.0443
No log	0.9825	56	1.0562	0.4598	1.0562	1.0277
No log	1.0175	58	1.0554	0.4319	1.0554	1.0273
No log	1.0526	60	1.0033	0.5273	1.0033	1.0016
No log	1.0877	62	1.2033	0.3526	1.2033	1.0969
No log	1.1228	64	1.3664	0.2592	1.3664	1.1690
No log	1.1579	66	1.2987	0.2682	1.2987	1.1396
No log	1.1930	68	1.0575	0.4514	1.0575	1.0284
No log	1.2281	70	0.9775	0.4980	0.9775	0.9887
No log	1.2632	72	0.9833	0.4901	0.9833	0.9916
No log	1.2982	74	0.9579	0.4617	0.9579	0.9787
No log	1.3333	76	0.9904	0.5066	0.9904	0.9952
No log	1.3684	78	1.1125	0.4334	1.1125	1.0548
No log	1.4035	80	1.1606	0.3934	1.1606	1.0773
No log	1.4386	82	1.1454	0.4126	1.1454	1.0702
No log	1.4737	84	1.1550	0.4401	1.1550	1.0747
No log	1.5088	86	1.0881	0.5002	1.0881	1.0431
No log	1.5439	88	1.1197	0.5026	1.1197	1.0582
No log	1.5789	90	1.3791	0.4220	1.3791	1.1743
No log	1.6140	92	1.6311	0.3753	1.6311	1.2772
No log	1.6491	94	1.7659	0.3486	1.7659	1.3289
No log	1.6842	96	1.8010	0.3468	1.8010	1.3420
No log	1.7193	98	1.6804	0.3333	1.6804	1.2963
No log	1.7544	100	1.4475	0.3751	1.4475	1.2031
No log	1.7895	102	1.5378	0.3473	1.5378	1.2401
No log	1.8246	104	1.4140	0.3919	1.4140	1.1891
No log	1.8596	106	1.3074	0.4862	1.3074	1.1434
No log	1.8947	108	1.3441	0.4482	1.3441	1.1593
No log	1.9298	110	1.2587	0.4822	1.2587	1.1219
No log	1.9649	112	1.0786	0.5682	1.0786	1.0385
No log	2.0	114	1.0296	0.5570	1.0296	1.0147
No log	2.0351	116	1.1397	0.5342	1.1397	1.0676
No log	2.0702	118	1.1730	0.5224	1.1730	1.0830
No log	2.1053	120	1.1922	0.5290	1.1922	1.0919
No log	2.1404	122	1.1426	0.5465	1.1426	1.0689
No log	2.1754	124	0.9891	0.5824	0.9891	0.9945
No log	2.2105	126	1.0065	0.6119	1.0065	1.0032
No log	2.2456	128	1.1383	0.5813	1.1383	1.0669
No log	2.2807	130	1.1375	0.5863	1.1375	1.0665
No log	2.3158	132	0.9579	0.6620	0.9579	0.9787
No log	2.3509	134	0.8164	0.6366	0.8164	0.9036
No log	2.3860	136	0.7971	0.6317	0.7971	0.8928
No log	2.4211	138	0.8048	0.6405	0.8048	0.8971
No log	2.4561	140	0.9190	0.6392	0.9190	0.9586
No log	2.4912	142	1.0813	0.5869	1.0813	1.0399
No log	2.5263	144	1.0556	0.5950	1.0556	1.0274
No log	2.5614	146	0.9269	0.6369	0.9269	0.9628
No log	2.5965	148	0.7911	0.6443	0.7911	0.8894
No log	2.6316	150	0.7650	0.6473	0.7650	0.8746
No log	2.6667	152	0.7552	0.6483	0.7552	0.8690
No log	2.7018	154	0.7931	0.6776	0.7931	0.8906
No log	2.7368	156	0.9051	0.6703	0.9051	0.9514
No log	2.7719	158	0.8814	0.6802	0.8814	0.9388
No log	2.8070	160	0.7733	0.6859	0.7733	0.8794
No log	2.8421	162	0.6956	0.7139	0.6956	0.8340
No log	2.8772	164	0.6813	0.6815	0.6813	0.8254
No log	2.9123	166	0.7029	0.7380	0.7029	0.8384
No log	2.9474	168	0.8407	0.6554	0.8407	0.9169
No log	2.9825	170	1.2353	0.5974	1.2353	1.1114
No log	3.0175	172	1.4157	0.5747	1.4157	1.1898
No log	3.0526	174	1.3245	0.5806	1.3245	1.1509
No log	3.0877	176	1.0334	0.6300	1.0334	1.0166
No log	3.1228	178	0.8457	0.6679	0.8457	0.9196
No log	3.1579	180	0.7646	0.6767	0.7646	0.8744
No log	3.1930	182	0.7600	0.6804	0.7600	0.8718
No log	3.2281	184	0.7752	0.6705	0.7752	0.8805
No log	3.2632	186	0.7906	0.6433	0.7906	0.8892
No log	3.2982	188	0.8758	0.6326	0.8758	0.9358
No log	3.3333	190	1.0606	0.6464	1.0606	1.0298
No log	3.3684	192	1.1799	0.6367	1.1799	1.0862
No log	3.4035	194	1.1654	0.6293	1.1654	1.0795
No log	3.4386	196	0.9749	0.6821	0.9749	0.9874
No log	3.4737	198	0.8796	0.6922	0.8796	0.9379
No log	3.5088	200	0.7764	0.6648	0.7764	0.8811
No log	3.5439	202	0.7648	0.6611	0.7648	0.8745
No log	3.5789	204	0.8576	0.6714	0.8576	0.9260
No log	3.6140	206	0.9623	0.6555	0.9623	0.9810
No log	3.6491	208	1.1696	0.6280	1.1696	1.0815
No log	3.6842	210	1.1748	0.6338	1.1748	1.0839
No log	3.7193	212	0.9976	0.6412	0.9976	0.9988
No log	3.7544	214	0.8374	0.6949	0.8374	0.9151
No log	3.7895	216	0.7567	0.6343	0.7567	0.8699
No log	3.8246	218	0.7805	0.6371	0.7805	0.8834
No log	3.8596	220	0.7705	0.6259	0.7705	0.8778
No log	3.8947	222	0.7477	0.6564	0.7477	0.8647
No log	3.9298	224	0.8719	0.6573	0.8719	0.9338
No log	3.9649	226	1.1422	0.6282	1.1422	1.0687
No log	4.0	228	1.2403	0.6255	1.2403	1.1137
No log	4.0351	230	1.1202	0.6250	1.1202	1.0584
No log	4.0702	232	0.9070	0.6554	0.9070	0.9523
No log	4.1053	234	0.7249	0.6537	0.7249	0.8514
No log	4.1404	236	0.6873	0.6855	0.6873	0.8290
No log	4.1754	238	0.6979	0.6818	0.6979	0.8354
No log	4.2105	240	0.7610	0.6784	0.7610	0.8724
No log	4.2456	242	0.9322	0.6489	0.9322	0.9655
No log	4.2807	244	1.1720	0.6245	1.1720	1.0826
No log	4.3158	246	1.2132	0.6010	1.2132	1.1014
No log	4.3509	248	1.1644	0.6272	1.1644	1.0791
No log	4.3860	250	1.0822	0.6286	1.0822	1.0403
No log	4.4211	252	1.1257	0.6170	1.1257	1.0610
No log	4.4561	254	1.2304	0.6029	1.2304	1.1092
No log	4.4912	256	1.1911	0.6095	1.1911	1.0914
No log	4.5263	258	1.2228	0.6009	1.2228	1.1058
No log	4.5614	260	1.2233	0.5967	1.2233	1.1060
No log	4.5965	262	1.0785	0.6344	1.0785	1.0385
No log	4.6316	264	0.9806	0.6310	0.9806	0.9902
No log	4.6667	266	0.9026	0.6341	0.9026	0.9501
No log	4.7018	268	0.8212	0.6678	0.8212	0.9062
No log	4.7368	270	0.7739	0.6463	0.7739	0.8797
No log	4.7719	272	0.7925	0.6544	0.7925	0.8902
No log	4.8070	274	0.9028	0.6424	0.9028	0.9502
No log	4.8421	276	1.0634	0.6350	1.0634	1.0312
No log	4.8772	278	1.1742	0.6204	1.1742	1.0836
No log	4.9123	280	1.1211	0.6319	1.1211	1.0588
No log	4.9474	282	1.1023	0.6347	1.1023	1.0499
No log	4.9825	284	1.1260	0.6434	1.1260	1.0611
No log	5.0175	286	1.0574	0.6425	1.0574	1.0283
No log	5.0526	288	1.0202	0.6425	1.0202	1.0101
No log	5.0877	290	1.0196	0.6425	1.0196	1.0098
No log	5.1228	292	1.0394	0.6437	1.0394	1.0195
No log	5.1579	294	1.0848	0.6347	1.0848	1.0415
No log	5.1930	296	1.0778	0.6347	1.0778	1.0382
No log	5.2281	298	0.9947	0.6286	0.9947	0.9974
No log	5.2632	300	0.8547	0.6631	0.8547	0.9245
No log	5.2982	302	0.7636	0.6829	0.7636	0.8738
No log	5.3333	304	0.7581	0.6930	0.7581	0.8707
No log	5.3684	306	0.8053	0.6621	0.8053	0.8974
No log	5.4035	308	0.8915	0.6617	0.8915	0.9442
No log	5.4386	310	0.9771	0.6655	0.9771	0.9885
No log	5.4737	312	1.0145	0.6616	1.0145	1.0072
No log	5.5088	314	1.0224	0.6575	1.0224	1.0111
No log	5.5439	316	0.9702	0.6542	0.9702	0.9850
No log	5.5789	318	0.8754	0.6541	0.8754	0.9356
No log	5.6140	320	0.8490	0.6438	0.8490	0.9214
No log	5.6491	322	0.8630	0.6392	0.8630	0.9290
No log	5.6842	324	0.8944	0.6569	0.8944	0.9457
No log	5.7193	326	0.9712	0.6556	0.9712	0.9855
No log	5.7544	328	1.1024	0.6327	1.1024	1.0499
No log	5.7895	330	1.1728	0.6312	1.1728	1.0829
No log	5.8246	332	1.1177	0.6368	1.1177	1.0572
No log	5.8596	334	1.0048	0.6653	1.0048	1.0024
No log	5.8947	336	0.8614	0.6605	0.8614	0.9281
No log	5.9298	338	0.8071	0.6386	0.8071	0.8984
No log	5.9649	340	0.8036	0.6386	0.8036	0.8964
No log	6.0	342	0.8480	0.6633	0.8480	0.9208
No log	6.0351	344	0.9239	0.6467	0.9239	0.9612
No log	6.0702	346	0.9407	0.6687	0.9407	0.9699
No log	6.1053	348	0.9727	0.6600	0.9727	0.9863
No log	6.1404	350	0.9436	0.6723	0.9436	0.9714
No log	6.1754	352	0.9261	0.6634	0.9261	0.9623
No log	6.2105	354	0.9246	0.6634	0.9246	0.9615
No log	6.2456	356	0.8726	0.6560	0.8726	0.9341
No log	6.2807	358	0.8240	0.6294	0.8240	0.9077
No log	6.3158	360	0.8308	0.6413	0.8308	0.9115
No log	6.3509	362	0.8581	0.6571	0.8581	0.9263
No log	6.3860	364	0.9387	0.6705	0.9387	0.9689
No log	6.4211	366	1.0084	0.6402	1.0084	1.0042
No log	6.4561	368	1.0220	0.6492	1.0220	1.0110
No log	6.4912	370	1.0334	0.6492	1.0334	1.0166
No log	6.5263	372	0.9754	0.6585	0.9754	0.9876
No log	6.5614	374	0.8871	0.6526	0.8871	0.9419
No log	6.5965	376	0.8009	0.6569	0.8009	0.8949
No log	6.6316	378	0.7688	0.6781	0.7688	0.8768
No log	6.6667	380	0.7660	0.6781	0.7660	0.8752
No log	6.7018	382	0.7953	0.6659	0.7953	0.8918
No log	6.7368	384	0.8813	0.6526	0.8813	0.9388
No log	6.7719	386	0.9799	0.6372	0.9799	0.9899
No log	6.8070	388	1.0275	0.6300	1.0275	1.0137
No log	6.8421	390	1.0949	0.6305	1.0949	1.0464
No log	6.8772	392	1.0995	0.6347	1.0995	1.0486
No log	6.9123	394	1.0445	0.6286	1.0445	1.0220
No log	6.9474	396	0.9685	0.6418	0.9685	0.9841
No log	6.9825	398	0.9384	0.6521	0.9384	0.9687
No log	7.0175	400	0.9092	0.6521	0.9092	0.9535
No log	7.0526	402	0.8804	0.6365	0.8804	0.9383
No log	7.0877	404	0.8921	0.6365	0.8921	0.9445
No log	7.1228	406	0.8878	0.6365	0.8878	0.9422
No log	7.1579	408	0.8991	0.6521	0.8991	0.9482
No log	7.1930	410	0.9053	0.6477	0.9053	0.9515
No log	7.2281	412	0.9058	0.6477	0.9058	0.9518
No log	7.2632	414	0.8842	0.6697	0.8842	0.9403
No log	7.2982	416	0.8660	0.6634	0.8660	0.9306
No log	7.3333	418	0.8523	0.6616	0.8523	0.9232
No log	7.3684	420	0.8490	0.6616	0.8490	0.9214
No log	7.4035	422	0.8730	0.6554	0.8730	0.9344
No log	7.4386	424	0.9096	0.6590	0.9096	0.9537
No log	7.4737	426	0.9062	0.6369	0.9062	0.9519
No log	7.5088	428	0.8942	0.6369	0.8942	0.9456
No log	7.5439	430	0.8875	0.6325	0.8875	0.9421
No log	7.5789	432	0.8763	0.6465	0.8763	0.9361
No log	7.6140	434	0.9049	0.6325	0.9049	0.9512
No log	7.6491	436	0.9510	0.6480	0.9510	0.9752
No log	7.6842	438	0.9647	0.6492	0.9647	0.9822
No log	7.7193	440	0.9868	0.6526	0.9868	0.9934
No log	7.7544	442	0.9922	0.6476	0.9922	0.9961
No log	7.7895	444	0.9872	0.6476	0.9872	0.9936
No log	7.8246	446	0.9622	0.6480	0.9622	0.9809
No log	7.8596	448	0.9261	0.6389	0.9261	0.9623
No log	7.8947	450	0.8883	0.6369	0.8883	0.9425
No log	7.9298	452	0.8739	0.6430	0.8739	0.9348
No log	7.9649	454	0.8683	0.6482	0.8683	0.9318
No log	8.0	456	0.8768	0.6325	0.8768	0.9364
No log	8.0351	458	0.8794	0.6325	0.8794	0.9377
No log	8.0702	460	0.8977	0.6325	0.8977	0.9474
No log	8.1053	462	0.9440	0.6424	0.9440	0.9716
No log	8.1404	464	0.9924	0.6499	0.9924	0.9962
No log	8.1754	466	1.0109	0.6468	1.0109	1.0054
No log	8.2105	468	1.0210	0.6468	1.0210	1.0104
No log	8.2456	470	0.9891	0.6510	0.9891	0.9945
No log	8.2807	472	0.9435	0.6360	0.9435	0.9714
No log	8.3158	474	0.9122	0.6369	0.9122	0.9551
No log	8.3509	476	0.8701	0.6679	0.8701	0.9328
No log	8.3860	478	0.8230	0.6867	0.8230	0.9072
No log	8.4211	480	0.8034	0.6778	0.8034	0.8963
No log	8.4561	482	0.8015	0.6778	0.8015	0.8953
No log	8.4912	484	0.8067	0.6867	0.8067	0.8982
No log	8.5263	486	0.8293	0.6929	0.8293	0.9106
No log	8.5614	488	0.8565	0.6705	0.8565	0.9255
No log	8.5965	490	0.8872	0.6435	0.8872	0.9419
No log	8.6316	492	0.9372	0.6505	0.9372	0.9681
No log	8.6667	494	0.9645	0.6387	0.9645	0.9821
No log	8.7018	496	0.9730	0.6385	0.9730	0.9864
No log	8.7368	498	0.9592	0.6508	0.9592	0.9794
0.3194	8.7719	500	0.9378	0.6619	0.9378	0.9684
0.3194	8.8070	502	0.9072	0.6538	0.9072	0.9525
0.3194	8.8421	504	0.8821	0.6502	0.8821	0.9392
0.3194	8.8772	506	0.8626	0.6546	0.8626	0.9288
0.3194	8.9123	508	0.8448	0.6597	0.8448	0.9192
0.3194	8.9474	510	0.8465	0.6499	0.8465	0.9201
0.3194	8.9825	512	0.8512	0.6563	0.8512	0.9226
0.3194	9.0175	514	0.8659	0.6546	0.8659	0.9305
0.3194	9.0526	516	0.8754	0.6502	0.8754	0.9356
0.3194	9.0877	518	0.8872	0.6592	0.8872	0.9419
0.3194	9.1228	520	0.8860	0.6592	0.8860	0.9413
0.3194	9.1579	522	0.8741	0.6502	0.8741	0.9349
0.3194	9.1930	524	0.8653	0.6518	0.8653	0.9302
0.3194	9.2281	526	0.8657	0.6518	0.8657	0.9305
0.3194	9.2632	528	0.8754	0.6502	0.8754	0.9356
0.3194	9.2982	530	0.8762	0.6502	0.8762	0.9361
0.3194	9.3333	532	0.8832	0.6502	0.8832	0.9398
0.3194	9.3684	534	0.8883	0.6502	0.8883	0.9425
0.3194	9.4035	536	0.8843	0.6502	0.8843	0.9404
0.3194	9.4386	538	0.8809	0.6502	0.8809	0.9386
0.3194	9.4737	540	0.8784	0.6502	0.8784	0.9372
0.3194	9.5088	542	0.8734	0.6502	0.8734	0.9345
0.3194	9.5439	544	0.8672	0.6518	0.8672	0.9313
0.3194	9.5789	546	0.8648	0.6518	0.8648	0.9299
0.3194	9.6140	548	0.8600	0.6518	0.8600	0.9274
0.3194	9.6491	550	0.8576	0.6518	0.8576	0.9261
0.3194	9.6842	552	0.8589	0.6518	0.8589	0.9268
0.3194	9.7193	554	0.8618	0.6502	0.8618	0.9283
0.3194	9.7544	556	0.8622	0.6502	0.8622	0.9285
0.3194	9.7895	558	0.8586	0.6502	0.8586	0.9266
0.3194	9.8246	560	0.8557	0.6502	0.8557	0.9251
0.3194	9.8596	562	0.8550	0.6502	0.8550	0.9246
0.3194	9.8947	564	0.8544	0.6518	0.8544	0.9243
0.3194	9.9298	566	0.8539	0.6518	0.8539	0.9241
0.3194	9.9649	568	0.8538	0.6518	0.8538	0.9240
0.3194	10.0	570	0.8535	0.6518	0.8535	0.9238

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1