ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run3_AugV5_k18_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7235
• Qwk: 0.6465
• Mse: 0.7235
• Rmse: 0.8506

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0225	2	5.6009	-0.0228	5.6009	2.3666
No log	0.0449	4	3.6243	0.0590	3.6243	1.9037
No log	0.0674	6	2.2686	0.0725	2.2686	1.5062
No log	0.0899	8	2.1633	-0.0471	2.1633	1.4708
No log	0.1124	10	1.7894	0.0408	1.7894	1.3377
No log	0.1348	12	1.3165	0.1631	1.3165	1.1474
No log	0.1573	14	1.2352	0.2389	1.2352	1.1114
No log	0.1798	16	1.1970	0.2773	1.1970	1.0941
No log	0.2022	18	1.2053	0.1799	1.2053	1.0979
No log	0.2247	20	1.2091	0.1703	1.2091	1.0996
No log	0.2472	22	1.2570	0.2396	1.2570	1.1212
No log	0.2697	24	1.2684	0.2670	1.2684	1.1262
No log	0.2921	26	1.2315	0.1965	1.2315	1.1097
No log	0.3146	28	1.2474	0.1695	1.2474	1.1169
No log	0.3371	30	1.1640	0.2578	1.1640	1.0789
No log	0.3596	32	1.1495	0.2501	1.1495	1.0722
No log	0.3820	34	1.1653	0.2722	1.1653	1.0795
No log	0.4045	36	1.1228	0.2715	1.1228	1.0596
No log	0.4270	38	1.1394	0.1985	1.1394	1.0674
No log	0.4494	40	1.1604	0.2050	1.1604	1.0772
No log	0.4719	42	1.0301	0.3485	1.0301	1.0149
No log	0.4944	44	1.0312	0.4037	1.0312	1.0155
No log	0.5169	46	1.1133	0.3304	1.1133	1.0551
No log	0.5393	48	1.0565	0.4120	1.0565	1.0279
No log	0.5618	50	0.8626	0.4725	0.8626	0.9287
No log	0.5843	52	0.7872	0.4936	0.7872	0.8872
No log	0.6067	54	0.7591	0.5667	0.7591	0.8713
No log	0.6292	56	0.8761	0.6104	0.8761	0.9360
No log	0.6517	58	0.8229	0.5908	0.8229	0.9072
No log	0.6742	60	0.7790	0.6350	0.7790	0.8826
No log	0.6966	62	0.8178	0.6300	0.8178	0.9043
No log	0.7191	64	0.7781	0.6312	0.7781	0.8821
No log	0.7416	66	0.7113	0.6747	0.7113	0.8434
No log	0.7640	68	0.7513	0.6513	0.7513	0.8668
No log	0.7865	70	0.8382	0.5995	0.8382	0.9155
No log	0.8090	72	0.8121	0.5955	0.8121	0.9012
No log	0.8315	74	0.7124	0.6654	0.7124	0.8440
No log	0.8539	76	0.6389	0.7084	0.6389	0.7993
No log	0.8764	78	0.6755	0.6686	0.6755	0.8219
No log	0.8989	80	1.0106	0.5965	1.0106	1.0053
No log	0.9213	82	1.1349	0.5117	1.1349	1.0653
No log	0.9438	84	0.8591	0.6302	0.8591	0.9269
No log	0.9663	86	0.6454	0.7111	0.6454	0.8034
No log	0.9888	88	0.6586	0.6770	0.6586	0.8115
No log	1.0112	90	0.7833	0.5775	0.7833	0.8851
No log	1.0337	92	1.0001	0.5443	1.0001	1.0001
No log	1.0562	94	1.0511	0.5366	1.0511	1.0252
No log	1.0787	96	0.7918	0.6137	0.7918	0.8898
No log	1.1011	98	0.7993	0.6355	0.7993	0.8940
No log	1.1236	100	0.9362	0.5900	0.9362	0.9676
No log	1.1461	102	0.8807	0.5823	0.8807	0.9384
No log	1.1685	104	0.6652	0.7034	0.6652	0.8156
No log	1.1910	106	0.6537	0.6945	0.6537	0.8085
No log	1.2135	108	0.6647	0.6573	0.6647	0.8153
No log	1.2360	110	0.6865	0.6154	0.6865	0.8286
No log	1.2584	112	0.6958	0.6123	0.6958	0.8342
No log	1.2809	114	0.6537	0.6379	0.6537	0.8085
No log	1.3034	116	0.6932	0.6481	0.6932	0.8326
No log	1.3258	118	0.6517	0.7099	0.6517	0.8073
No log	1.3483	120	0.6436	0.7115	0.6436	0.8023
No log	1.3708	122	0.6869	0.6750	0.6869	0.8288
No log	1.3933	124	0.6410	0.7172	0.6410	0.8007
No log	1.4157	126	0.6409	0.7273	0.6409	0.8006
No log	1.4382	128	0.6624	0.7044	0.6624	0.8139
No log	1.4607	130	0.6493	0.6766	0.6493	0.8058
No log	1.4831	132	0.6457	0.6883	0.6457	0.8036
No log	1.5056	134	0.6764	0.6998	0.6764	0.8224
No log	1.5281	136	0.6862	0.7075	0.6862	0.8284
No log	1.5506	138	0.6357	0.7219	0.6357	0.7973
No log	1.5730	140	0.6436	0.7352	0.6436	0.8022
No log	1.5955	142	0.6651	0.7094	0.6651	0.8155
No log	1.6180	144	0.7199	0.6763	0.7199	0.8485
No log	1.6404	146	0.6838	0.7166	0.6838	0.8269
No log	1.6629	148	0.6654	0.7318	0.6654	0.8157
No log	1.6854	150	0.7746	0.6929	0.7746	0.8801
No log	1.7079	152	1.1325	0.4866	1.1325	1.0642
No log	1.7303	154	1.1157	0.4817	1.1157	1.0563
No log	1.7528	156	0.8225	0.6560	0.8225	0.9069
No log	1.7753	158	0.7163	0.6523	0.7163	0.8463
No log	1.7978	160	0.6953	0.6375	0.6953	0.8338
No log	1.8202	162	0.6890	0.6336	0.6890	0.8301
No log	1.8427	164	0.6673	0.6373	0.6673	0.8169
No log	1.8652	166	0.6995	0.6336	0.6995	0.8364
No log	1.8876	168	0.6707	0.6365	0.6707	0.8189
No log	1.9101	170	0.6509	0.6510	0.6509	0.8068
No log	1.9326	172	0.6599	0.6218	0.6599	0.8124
No log	1.9551	174	0.8117	0.6104	0.8117	0.9010
No log	1.9775	176	0.8936	0.6074	0.8936	0.9453
No log	2.0	178	0.7225	0.6271	0.7225	0.8500
No log	2.0225	180	0.7182	0.5955	0.7182	0.8474
No log	2.0449	182	0.8381	0.6032	0.8381	0.9155
No log	2.0674	184	0.7593	0.5804	0.7593	0.8714
No log	2.0899	186	0.6959	0.6053	0.6959	0.8342
No log	2.1124	188	0.7028	0.6096	0.7028	0.8383
No log	2.1348	190	0.7365	0.5651	0.7365	0.8582
No log	2.1573	192	0.7406	0.5407	0.7406	0.8606
No log	2.1798	194	0.7920	0.5679	0.7920	0.8899
No log	2.2022	196	0.7737	0.5883	0.7737	0.8796
No log	2.2247	198	0.6954	0.5464	0.6954	0.8339
No log	2.2472	200	0.7188	0.6248	0.7188	0.8478
No log	2.2697	202	0.7507	0.6267	0.7507	0.8664
No log	2.2921	204	0.6794	0.6858	0.6794	0.8243
No log	2.3146	206	0.6817	0.6518	0.6817	0.8256
No log	2.3371	208	0.6905	0.6530	0.6905	0.8309
No log	2.3596	210	0.7058	0.6222	0.7058	0.8401
No log	2.3820	212	0.6875	0.6385	0.6875	0.8292
No log	2.4045	214	0.6464	0.6649	0.6464	0.8040
No log	2.4270	216	0.6365	0.6932	0.6365	0.7978
No log	2.4494	218	0.6375	0.7076	0.6375	0.7985
No log	2.4719	220	0.6256	0.6726	0.6256	0.7909
No log	2.4944	222	0.6181	0.6756	0.6181	0.7862
No log	2.5169	224	0.6382	0.6974	0.6382	0.7989
No log	2.5393	226	0.6211	0.6700	0.6211	0.7881
No log	2.5618	228	0.6405	0.6777	0.6405	0.8003
No log	2.5843	230	0.7690	0.6609	0.7690	0.8769
No log	2.6067	232	0.7861	0.6600	0.7861	0.8866
No log	2.6292	234	0.7464	0.6694	0.7464	0.8640
No log	2.6517	236	0.7080	0.6436	0.7080	0.8414
No log	2.6742	238	0.6340	0.6631	0.6340	0.7962
No log	2.6966	240	0.6777	0.7287	0.6777	0.8232
No log	2.7191	242	0.6845	0.7460	0.6845	0.8274
No log	2.7416	244	0.6378	0.7085	0.6378	0.7986
No log	2.7640	246	0.6803	0.6773	0.6803	0.8248
No log	2.7865	248	0.7018	0.6682	0.7018	0.8377
No log	2.8090	250	0.6427	0.6898	0.6427	0.8017
No log	2.8315	252	0.6230	0.7635	0.6230	0.7893
No log	2.8539	254	0.6190	0.7628	0.6190	0.7868
No log	2.8764	256	0.6487	0.6793	0.6487	0.8054
No log	2.8989	258	0.6914	0.6807	0.6914	0.8315
No log	2.9213	260	0.7326	0.6953	0.7326	0.8559
No log	2.9438	262	0.7258	0.6988	0.7258	0.8520
No log	2.9663	264	0.7757	0.7193	0.7757	0.8808
No log	2.9888	266	0.7599	0.7092	0.7599	0.8717
No log	3.0112	268	0.7248	0.7075	0.7248	0.8514
No log	3.0337	270	0.7883	0.6938	0.7883	0.8879
No log	3.0562	272	0.8026	0.7011	0.8026	0.8959
No log	3.0787	274	0.7691	0.6538	0.7691	0.8770
No log	3.1011	276	0.7001	0.6663	0.7001	0.8367
No log	3.1236	278	0.6761	0.6863	0.6761	0.8223
No log	3.1461	280	0.6943	0.6282	0.6943	0.8333
No log	3.1685	282	0.6992	0.6132	0.6992	0.8362
No log	3.1910	284	0.7323	0.5870	0.7323	0.8557
No log	3.2135	286	0.8155	0.5919	0.8155	0.9030
No log	3.2360	288	0.7897	0.5919	0.7897	0.8886
No log	3.2584	290	0.6739	0.6540	0.6739	0.8209
No log	3.2809	292	0.6299	0.7048	0.6299	0.7937
No log	3.3034	294	0.6310	0.7125	0.6310	0.7944
No log	3.3258	296	0.6960	0.6780	0.6960	0.8343
No log	3.3483	298	0.9045	0.6086	0.9045	0.9510
No log	3.3708	300	1.1398	0.4678	1.1398	1.0676
No log	3.3933	302	1.1696	0.4337	1.1696	1.0815
No log	3.4157	304	1.0464	0.5198	1.0464	1.0229
No log	3.4382	306	0.9093	0.5274	0.9093	0.9536
No log	3.4607	308	0.8477	0.5364	0.8477	0.9207
No log	3.4831	310	0.8424	0.5622	0.8424	0.9178
No log	3.5056	312	0.7752	0.5958	0.7752	0.8804
No log	3.5281	314	0.7038	0.6295	0.7038	0.8389
No log	3.5506	316	0.7024	0.6203	0.7024	0.8381
No log	3.5730	318	0.8051	0.6101	0.8051	0.8973
No log	3.5955	320	1.0450	0.5458	1.0450	1.0222
No log	3.6180	322	1.0654	0.5594	1.0654	1.0322
No log	3.6404	324	0.8623	0.5924	0.8623	0.9286
No log	3.6629	326	0.6735	0.6398	0.6735	0.8207
No log	3.6854	328	0.6463	0.6375	0.6463	0.8039
No log	3.7079	330	0.7171	0.6507	0.7171	0.8468
No log	3.7303	332	0.7240	0.6457	0.7240	0.8509
No log	3.7528	334	0.6797	0.6085	0.6797	0.8244
No log	3.7753	336	0.6454	0.6502	0.6454	0.8034
No log	3.7978	338	0.6329	0.6835	0.6329	0.7956
No log	3.8202	340	0.6303	0.6790	0.6303	0.7939
No log	3.8427	342	0.7014	0.6685	0.7014	0.8375
No log	3.8652	344	0.8944	0.6221	0.8944	0.9458
No log	3.8876	346	0.9643	0.5780	0.9643	0.9820
No log	3.9101	348	0.8235	0.6487	0.8235	0.9075
No log	3.9326	350	0.6375	0.7180	0.6375	0.7984
No log	3.9551	352	0.6008	0.7060	0.6008	0.7751
No log	3.9775	354	0.5981	0.7015	0.5981	0.7734
No log	4.0	356	0.5953	0.7043	0.5953	0.7716
No log	4.0225	358	0.6959	0.6872	0.6959	0.8342
No log	4.0449	360	0.8154	0.6339	0.8154	0.9030
No log	4.0674	362	0.7852	0.6430	0.7852	0.8861
No log	4.0899	364	0.7623	0.6448	0.7623	0.8731
No log	4.1124	366	0.6860	0.6584	0.6860	0.8283
No log	4.1348	368	0.6591	0.6189	0.6591	0.8119
No log	4.1573	370	0.6788	0.6249	0.6788	0.8239
No log	4.1798	372	0.7403	0.6393	0.7403	0.8604
No log	4.2022	374	0.7136	0.6296	0.7136	0.8447
No log	4.2247	376	0.6484	0.6381	0.6484	0.8052
No log	4.2472	378	0.6315	0.6717	0.6315	0.7947
No log	4.2697	380	0.6375	0.6663	0.6375	0.7985
No log	4.2921	382	0.7229	0.6463	0.7229	0.8502
No log	4.3146	384	0.8826	0.6101	0.8826	0.9395
No log	4.3371	386	0.9396	0.6098	0.9396	0.9693
No log	4.3596	388	0.8970	0.6074	0.8970	0.9471
No log	4.3820	390	0.7555	0.6297	0.7555	0.8692
No log	4.4045	392	0.6482	0.6460	0.6482	0.8051
No log	4.4270	394	0.6353	0.6576	0.6353	0.7971
No log	4.4494	396	0.6428	0.6322	0.6428	0.8017
No log	4.4719	398	0.6826	0.6219	0.6826	0.8262
No log	4.4944	400	0.6985	0.6324	0.6985	0.8358
No log	4.5169	402	0.6446	0.6614	0.6446	0.8029
No log	4.5393	404	0.6003	0.7136	0.6003	0.7748
No log	4.5618	406	0.6113	0.6945	0.6113	0.7818
No log	4.5843	408	0.6233	0.6799	0.6233	0.7895
No log	4.6067	410	0.6897	0.6403	0.6897	0.8305
No log	4.6292	412	0.7896	0.6315	0.7896	0.8886
No log	4.6517	414	0.7874	0.6351	0.7874	0.8874
No log	4.6742	416	0.6949	0.6057	0.6949	0.8336
No log	4.6966	418	0.6603	0.6272	0.6603	0.8126
No log	4.7191	420	0.6720	0.6519	0.6720	0.8198
No log	4.7416	422	0.6439	0.6891	0.6439	0.8024
No log	4.7640	424	0.6230	0.6758	0.6230	0.7893
No log	4.7865	426	0.6980	0.6502	0.6980	0.8354
No log	4.8090	428	0.8352	0.6341	0.8352	0.9139
No log	4.8315	430	0.9260	0.6009	0.9260	0.9623
No log	4.8539	432	0.8457	0.6152	0.8457	0.9196
No log	4.8764	434	0.7205	0.6894	0.7205	0.8488
No log	4.8989	436	0.6815	0.6802	0.6815	0.8255
No log	4.9213	438	0.6885	0.6603	0.6885	0.8298
No log	4.9438	440	0.7584	0.6238	0.7584	0.8709
No log	4.9663	442	0.8318	0.6032	0.8318	0.9120
No log	4.9888	444	0.8600	0.5873	0.8600	0.9274
No log	5.0112	446	0.8959	0.5665	0.8959	0.9465
No log	5.0337	448	0.8904	0.5717	0.8904	0.9436
No log	5.0562	450	0.8125	0.6107	0.8125	0.9014
No log	5.0787	452	0.6742	0.6973	0.6742	0.8211
No log	5.1011	454	0.6539	0.7316	0.6539	0.8087
No log	5.1236	456	0.6473	0.7291	0.6473	0.8046
No log	5.1461	458	0.6694	0.6902	0.6694	0.8182
No log	5.1685	460	0.7910	0.6284	0.7910	0.8894
No log	5.1910	462	0.7986	0.6267	0.7986	0.8936
No log	5.2135	464	0.7005	0.6413	0.7005	0.8369
No log	5.2360	466	0.6304	0.7036	0.6304	0.7940
No log	5.2584	468	0.6215	0.7230	0.6215	0.7884
No log	5.2809	470	0.6903	0.6821	0.6903	0.8308
No log	5.3034	472	0.8702	0.6111	0.8702	0.9328
No log	5.3258	474	1.0105	0.5718	1.0105	1.0052
No log	5.3483	476	0.9643	0.5841	0.9643	0.9820
No log	5.3708	478	0.8019	0.6401	0.8019	0.8955
No log	5.3933	480	0.7100	0.6802	0.7100	0.8426
No log	5.4157	482	0.7891	0.6464	0.7891	0.8883
No log	5.4382	484	0.9864	0.6020	0.9864	0.9932
No log	5.4607	486	1.0783	0.5648	1.0783	1.0384
No log	5.4831	488	1.0047	0.5885	1.0047	1.0024
No log	5.5056	490	0.8344	0.6118	0.8344	0.9135
No log	5.5281	492	0.6962	0.6781	0.6962	0.8344
No log	5.5506	494	0.6407	0.7208	0.6407	0.8005
No log	5.5730	496	0.6447	0.7322	0.6447	0.8029
No log	5.5955	498	0.6340	0.7431	0.6340	0.7963
0.4002	5.6180	500	0.6251	0.7455	0.6251	0.7906
0.4002	5.6404	502	0.6301	0.7353	0.6301	0.7938
0.4002	5.6629	504	0.6900	0.6625	0.6900	0.8306
0.4002	5.6854	506	0.8125	0.6327	0.8125	0.9014
0.4002	5.7079	508	0.8148	0.6398	0.8148	0.9027
0.4002	5.7303	510	0.7235	0.6465	0.7235	0.8506

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1