ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run3_AugV5_k14_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9407
• Qwk: 0.5869
• Mse: 0.9407
• Rmse: 0.9699

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0290	2	5.3897	-0.0197	5.3897	2.3216
No log	0.0580	4	3.2689	0.0693	3.2689	1.8080
No log	0.0870	6	2.7029	-0.1346	2.7029	1.6441
No log	0.1159	8	2.0865	-0.0059	2.0865	1.4445
No log	0.1449	10	1.3940	0.0273	1.3940	1.1807
No log	0.1739	12	1.2692	0.1249	1.2692	1.1266
No log	0.2029	14	1.3148	0.1648	1.3148	1.1466
No log	0.2319	16	1.4236	0.2094	1.4236	1.1931
No log	0.2609	18	1.4710	0.2010	1.4710	1.2129
No log	0.2899	20	1.1927	0.3235	1.1927	1.0921
No log	0.3188	22	1.1649	0.2909	1.1649	1.0793
No log	0.3478	24	1.1486	0.3082	1.1486	1.0717
No log	0.3768	26	1.1166	0.3547	1.1166	1.0567
No log	0.4058	28	1.3291	0.2273	1.3291	1.1529
No log	0.4348	30	1.6126	0.2274	1.6126	1.2699
No log	0.4638	32	1.3261	0.25	1.3261	1.1516
No log	0.4928	34	1.1527	0.3612	1.1527	1.0736
No log	0.5217	36	1.0706	0.3350	1.0706	1.0347
No log	0.5507	38	1.0923	0.3434	1.0923	1.0451
No log	0.5797	40	1.1224	0.3274	1.1224	1.0594
No log	0.6087	42	1.2015	0.2961	1.2015	1.0961
No log	0.6377	44	1.2690	0.2138	1.2690	1.1265
No log	0.6667	46	1.2777	0.1634	1.2777	1.1303
No log	0.6957	48	1.3030	0.2333	1.3030	1.1415
No log	0.7246	50	1.4040	0.3028	1.4040	1.1849
No log	0.7536	52	1.5002	0.3075	1.5002	1.2248
No log	0.7826	54	1.1711	0.4418	1.1711	1.0822
No log	0.8116	56	1.0051	0.4524	1.0051	1.0025
No log	0.8406	58	1.0129	0.4430	1.0129	1.0064
No log	0.8696	60	1.2090	0.3761	1.2090	1.0995
No log	0.8986	62	1.6537	0.2591	1.6537	1.2860
No log	0.9275	64	1.5260	0.3225	1.5260	1.2353
No log	0.9565	66	1.0758	0.4275	1.0758	1.0372
No log	0.9855	68	0.9834	0.4078	0.9834	0.9917
No log	1.0145	70	1.1505	0.2831	1.1505	1.0726
No log	1.0435	72	1.2650	0.1695	1.2650	1.1247
No log	1.0725	74	1.3534	0.1388	1.3534	1.1634
No log	1.1014	76	1.2704	0.1872	1.2704	1.1271
No log	1.1304	78	1.1321	0.4277	1.1321	1.0640
No log	1.1594	80	1.1752	0.4431	1.1752	1.0841
No log	1.1884	82	1.2536	0.2535	1.2536	1.1196
No log	1.2174	84	1.3946	0.2514	1.3946	1.1809
No log	1.2464	86	1.5697	0.1803	1.5697	1.2529
No log	1.2754	88	1.5746	0.1813	1.5746	1.2548
No log	1.3043	90	1.3649	0.2307	1.3649	1.1683
No log	1.3333	92	1.0970	0.3904	1.0970	1.0474
No log	1.3623	94	0.9728	0.3836	0.9728	0.9863
No log	1.3913	96	1.0247	0.3893	1.0247	1.0123
No log	1.4203	98	0.9786	0.4038	0.9786	0.9892
No log	1.4493	100	0.9136	0.4609	0.9136	0.9558
No log	1.4783	102	0.8999	0.5235	0.8999	0.9486
No log	1.5072	104	0.9550	0.5100	0.9550	0.9772
No log	1.5362	106	0.9088	0.5685	0.9088	0.9533
No log	1.5652	108	0.9005	0.6054	0.9005	0.9489
No log	1.5942	110	0.9503	0.5208	0.9503	0.9748
No log	1.6232	112	0.8546	0.5909	0.8546	0.9244
No log	1.6522	114	0.8090	0.5582	0.8090	0.8995
No log	1.6812	116	0.8071	0.5730	0.8071	0.8984
No log	1.7101	118	0.8865	0.5625	0.8865	0.9416
No log	1.7391	120	1.1159	0.5480	1.1159	1.0564
No log	1.7681	122	1.0040	0.6101	1.0040	1.0020
No log	1.7971	124	0.9158	0.5545	0.9158	0.9570
No log	1.8261	126	1.0668	0.5305	1.0668	1.0329
No log	1.8551	128	1.0109	0.5372	1.0109	1.0055
No log	1.8841	130	0.9055	0.5609	0.9055	0.9516
No log	1.9130	132	0.9335	0.5417	0.9335	0.9662
No log	1.9420	134	0.9665	0.5211	0.9665	0.9831
No log	1.9710	136	0.9542	0.5063	0.9542	0.9768
No log	2.0	138	0.8867	0.5433	0.8867	0.9417
No log	2.0290	140	0.9331	0.5196	0.9331	0.9659
No log	2.0580	142	1.0419	0.5517	1.0419	1.0207
No log	2.0870	144	0.9169	0.5414	0.9169	0.9576
No log	2.1159	146	0.8344	0.5658	0.8344	0.9135
No log	2.1449	148	0.8640	0.5803	0.8640	0.9295
No log	2.1739	150	0.8311	0.5960	0.8311	0.9117
No log	2.2029	152	0.9341	0.5776	0.9341	0.9665
No log	2.2319	154	0.9671	0.5629	0.9671	0.9834
No log	2.2609	156	1.2247	0.4594	1.2247	1.1067
No log	2.2899	158	1.2602	0.4590	1.2602	1.1226
No log	2.3188	160	1.0368	0.5610	1.0368	1.0183
No log	2.3478	162	0.8309	0.6056	0.8309	0.9115
No log	2.3768	164	0.8513	0.6016	0.8513	0.9226
No log	2.4058	166	1.0286	0.5374	1.0286	1.0142
No log	2.4348	168	1.0425	0.5330	1.0425	1.0210
No log	2.4638	170	0.8381	0.6119	0.8381	0.9155
No log	2.4928	172	0.7639	0.6356	0.7639	0.8740
No log	2.5217	174	0.8762	0.5817	0.8762	0.9361
No log	2.5507	176	0.8081	0.5908	0.8081	0.8989
No log	2.5797	178	0.8786	0.5446	0.8786	0.9373
No log	2.6087	180	0.9622	0.5319	0.9622	0.9809
No log	2.6377	182	0.9486	0.4945	0.9486	0.9740
No log	2.6667	184	0.9647	0.5142	0.9647	0.9822
No log	2.6957	186	0.9228	0.5026	0.9228	0.9606
No log	2.7246	188	0.9145	0.5391	0.9145	0.9563
No log	2.7536	190	0.8520	0.5575	0.8520	0.9231
No log	2.7826	192	0.9554	0.5595	0.9554	0.9775
No log	2.8116	194	1.1632	0.4813	1.1632	1.0785
No log	2.8406	196	1.1621	0.4543	1.1621	1.0780
No log	2.8696	198	0.9487	0.5657	0.9487	0.9740
No log	2.8986	200	0.7213	0.6474	0.7213	0.8493
No log	2.9275	202	0.6903	0.6296	0.6903	0.8309
No log	2.9565	204	0.7007	0.6521	0.7007	0.8371
No log	2.9855	206	0.9143	0.5691	0.9143	0.9562
No log	3.0145	208	1.1158	0.5595	1.1158	1.0563
No log	3.0435	210	1.1377	0.5421	1.1377	1.0666
No log	3.0725	212	1.0658	0.5563	1.0658	1.0324
No log	3.1014	214	1.1292	0.5310	1.1292	1.0626
No log	3.1304	216	1.1273	0.5357	1.1273	1.0617
No log	3.1594	218	1.2035	0.5254	1.2035	1.0970
No log	3.1884	220	1.1472	0.5201	1.1472	1.0711
No log	3.2174	222	1.1479	0.5105	1.1479	1.0714
No log	3.2464	224	0.9153	0.5639	0.9153	0.9567
No log	3.2754	226	0.8293	0.5997	0.8293	0.9107
No log	3.3043	228	0.7732	0.5792	0.7732	0.8793
No log	3.3333	230	0.7705	0.6072	0.7705	0.8778
No log	3.3623	232	0.8388	0.5856	0.8388	0.9158
No log	3.3913	234	0.9902	0.5643	0.9902	0.9951
No log	3.4203	236	0.9641	0.5569	0.9641	0.9819
No log	3.4493	238	0.8608	0.5774	0.8608	0.9278
No log	3.4783	240	0.7828	0.6373	0.7828	0.8848
No log	3.5072	242	0.8107	0.5790	0.8107	0.9004
No log	3.5362	244	1.0058	0.5629	1.0058	1.0029
No log	3.5652	246	1.0290	0.5287	1.0290	1.0144
No log	3.5942	248	0.8488	0.6208	0.8488	0.9213
No log	3.6232	250	0.7422	0.6146	0.7422	0.8615
No log	3.6522	252	0.7426	0.6172	0.7426	0.8617
No log	3.6812	254	0.7940	0.6213	0.7940	0.8911
No log	3.7101	256	0.8495	0.6187	0.8495	0.9217
No log	3.7391	258	0.9161	0.6136	0.9161	0.9571
No log	3.7681	260	0.8123	0.6220	0.8123	0.9013
No log	3.7971	262	0.7366	0.6545	0.7366	0.8582
No log	3.8261	264	0.7790	0.6342	0.7790	0.8826
No log	3.8551	266	0.9043	0.5882	0.9043	0.9510
No log	3.8841	268	0.8326	0.5911	0.8326	0.9125
No log	3.9130	270	0.7962	0.6146	0.7962	0.8923
No log	3.9420	272	0.9010	0.6077	0.9010	0.9492
No log	3.9710	274	0.9863	0.5648	0.9863	0.9931
No log	4.0	276	0.8653	0.6396	0.8653	0.9302
No log	4.0290	278	0.8678	0.625	0.8678	0.9315
No log	4.0580	280	0.8987	0.6063	0.8987	0.9480
No log	4.0870	282	0.9275	0.5514	0.9275	0.9631
No log	4.1159	284	0.9363	0.5543	0.9363	0.9676
No log	4.1449	286	0.9743	0.5412	0.9743	0.9871
No log	4.1739	288	0.9748	0.5602	0.9748	0.9873
No log	4.2029	290	0.8921	0.5971	0.8921	0.9445
No log	4.2319	292	0.7317	0.6301	0.7317	0.8554
No log	4.2609	294	0.7109	0.6428	0.7109	0.8431
No log	4.2899	296	0.7186	0.6251	0.7186	0.8477
No log	4.3188	298	0.8221	0.6198	0.8221	0.9067
No log	4.3478	300	1.0608	0.5515	1.0608	1.0299
No log	4.3768	302	1.1725	0.4667	1.1725	1.0828
No log	4.4058	304	1.1252	0.5188	1.1252	1.0607
No log	4.4348	306	1.0180	0.5649	1.0180	1.0089
No log	4.4638	308	0.9104	0.6178	0.9104	0.9542
No log	4.4928	310	0.8643	0.6311	0.8643	0.9297
No log	4.5217	312	0.9673	0.6018	0.9673	0.9835
No log	4.5507	314	1.0734	0.5396	1.0734	1.0361
No log	4.5797	316	0.9129	0.5815	0.9129	0.9555
No log	4.6087	318	0.8606	0.5646	0.8606	0.9277
No log	4.6377	320	0.9348	0.5510	0.9348	0.9668
No log	4.6667	322	0.9294	0.5731	0.9294	0.9640
No log	4.6957	324	0.8692	0.5865	0.8692	0.9323
No log	4.7246	326	0.8687	0.5823	0.8687	0.9320
No log	4.7536	328	0.9009	0.5643	0.9009	0.9491
No log	4.7826	330	0.8020	0.6317	0.8020	0.8956
No log	4.8116	332	0.8039	0.6452	0.8039	0.8966
No log	4.8406	334	0.7891	0.6666	0.7891	0.8883
No log	4.8696	336	0.8709	0.6349	0.8709	0.9332
No log	4.8986	338	0.9666	0.6243	0.9666	0.9832
No log	4.9275	340	0.8986	0.6347	0.8986	0.9479
No log	4.9565	342	0.7666	0.6619	0.7666	0.8756
No log	4.9855	344	0.8844	0.6349	0.8844	0.9404
No log	5.0145	346	1.0905	0.5641	1.0905	1.0442
No log	5.0435	348	1.1882	0.5272	1.1882	1.0901
No log	5.0725	350	0.9963	0.5538	0.9963	0.9981
No log	5.1014	352	0.7176	0.6481	0.7176	0.8471
No log	5.1304	354	0.6814	0.5854	0.6814	0.8255
No log	5.1594	356	0.6726	0.6047	0.6726	0.8201
No log	5.1884	358	0.6944	0.6694	0.6944	0.8333
No log	5.2174	360	0.9239	0.5958	0.9239	0.9612
No log	5.2464	362	1.2400	0.5076	1.2400	1.1135
No log	5.2754	364	1.2595	0.5023	1.2595	1.1223
No log	5.3043	366	1.1922	0.5401	1.1922	1.0919
No log	5.3333	368	1.0140	0.5560	1.0140	1.0070
No log	5.3623	370	0.8580	0.6058	0.8580	0.9263
No log	5.3913	372	0.8197	0.6289	0.8197	0.9054
No log	5.4203	374	0.8338	0.6178	0.8338	0.9131
No log	5.4493	376	0.9527	0.5918	0.9527	0.9761
No log	5.4783	378	0.9616	0.5918	0.9616	0.9806
No log	5.5072	380	0.8225	0.6555	0.8225	0.9069
No log	5.5362	382	0.7538	0.6796	0.7538	0.8682
No log	5.5652	384	0.7887	0.6657	0.7887	0.8881
No log	5.5942	386	0.8616	0.6298	0.8616	0.9282
No log	5.6232	388	1.0319	0.5617	1.0319	1.0158
No log	5.6522	390	1.1668	0.5262	1.1668	1.0802
No log	5.6812	392	1.1530	0.5002	1.1530	1.0738
No log	5.7101	394	0.9573	0.5839	0.9573	0.9784
No log	5.7391	396	0.7760	0.6675	0.7760	0.8809
No log	5.7681	398	0.7260	0.6768	0.7260	0.8521
No log	5.7971	400	0.7634	0.6726	0.7634	0.8737
No log	5.8261	402	0.9283	0.6071	0.9283	0.9635
No log	5.8551	404	1.1163	0.5228	1.1163	1.0566
No log	5.8841	406	1.1602	0.5228	1.1602	1.0771
No log	5.9130	408	1.0185	0.5731	1.0185	1.0092
No log	5.9420	410	0.8161	0.6539	0.8161	0.9034
No log	5.9710	412	0.7849	0.6558	0.7849	0.8860
No log	6.0	414	0.9291	0.6179	0.9291	0.9639
No log	6.0290	416	0.9851	0.5971	0.9851	0.9925
No log	6.0580	418	1.0223	0.5858	1.0223	1.0111
No log	6.0870	420	0.9870	0.6202	0.9870	0.9935
No log	6.1159	422	0.8078	0.6894	0.8078	0.8988
No log	6.1449	424	0.6877	0.6829	0.6877	0.8293
No log	6.1739	426	0.6861	0.6829	0.6861	0.8283
No log	6.2029	428	0.7904	0.6809	0.7904	0.8890
No log	6.2319	430	1.1070	0.5630	1.1070	1.0521
No log	6.2609	432	1.2896	0.4626	1.2896	1.1356
No log	6.2899	434	1.1415	0.5059	1.1415	1.0684
No log	6.3188	436	0.8918	0.6299	0.8918	0.9443
No log	6.3478	438	0.8075	0.6304	0.8075	0.8986
No log	6.3768	440	0.7966	0.6624	0.7966	0.8926
No log	6.4058	442	0.7672	0.6749	0.7672	0.8759
No log	6.4348	444	0.8686	0.6314	0.8686	0.9320
No log	6.4638	446	0.8906	0.6140	0.8906	0.9437
No log	6.4928	448	0.7976	0.6507	0.7976	0.8931
No log	6.5217	450	0.7426	0.6317	0.7426	0.8617
No log	6.5507	452	0.6841	0.6344	0.6841	0.8271
No log	6.5797	454	0.6810	0.6286	0.6810	0.8252
No log	6.6087	456	0.7294	0.6276	0.7294	0.8540
No log	6.6377	458	0.7867	0.6248	0.7867	0.8870
No log	6.6667	460	0.7745	0.6129	0.7745	0.8801
No log	6.6957	462	0.6670	0.6232	0.6670	0.8167
No log	6.7246	464	0.6233	0.6331	0.6233	0.7895
No log	6.7536	466	0.6400	0.6517	0.6400	0.8000
No log	6.7826	468	0.7753	0.6676	0.7753	0.8805
No log	6.8116	470	0.8599	0.6425	0.8599	0.9273
No log	6.8406	472	0.7926	0.6507	0.7926	0.8903
No log	6.8696	474	0.6596	0.6913	0.6596	0.8122
No log	6.8986	476	0.6139	0.7019	0.6139	0.7835
No log	6.9275	478	0.5829	0.6821	0.5829	0.7635
No log	6.9565	480	0.5828	0.6821	0.5828	0.7634
No log	6.9855	482	0.5785	0.7192	0.5785	0.7606
No log	7.0145	484	0.6372	0.6975	0.6372	0.7983
No log	7.0435	486	0.7614	0.6384	0.7614	0.8726
No log	7.0725	488	0.7670	0.6327	0.7670	0.8758
No log	7.1014	490	0.7753	0.6256	0.7753	0.8805
No log	7.1304	492	0.7177	0.6399	0.7177	0.8472
No log	7.1594	494	0.6758	0.6885	0.6758	0.8221
No log	7.1884	496	0.7087	0.6420	0.7087	0.8418
No log	7.2174	498	0.7912	0.6331	0.7912	0.8895
0.4843	7.2464	500	0.8207	0.6309	0.8207	0.9060
0.4843	7.2754	502	0.8796	0.6567	0.8796	0.9379
0.4843	7.3043	504	0.8116	0.6522	0.8116	0.9009
0.4843	7.3333	506	0.7666	0.6627	0.7666	0.8756
0.4843	7.3623	508	0.7336	0.6815	0.7336	0.8565
0.4843	7.3913	510	0.7251	0.6877	0.7251	0.8515
0.4843	7.4203	512	0.8221	0.6667	0.8221	0.9067
0.4843	7.4493	514	0.9584	0.6140	0.9584	0.9790
0.4843	7.4783	516	1.0442	0.5881	1.0442	1.0219
0.4843	7.5072	518	1.0306	0.5824	1.0306	1.0152
0.4843	7.5362	520	0.9514	0.6050	0.9514	0.9754
0.4843	7.5652	522	0.8166	0.6630	0.8166	0.9037
0.4843	7.5942	524	0.8197	0.6412	0.8197	0.9054
0.4843	7.6232	526	0.9055	0.6131	0.9055	0.9516
0.4843	7.6522	528	0.8760	0.6445	0.8760	0.9360
0.4843	7.6812	530	0.8057	0.6605	0.8057	0.8976
0.4843	7.7101	532	0.7084	0.6632	0.7084	0.8416
0.4843	7.7391	534	0.6534	0.6468	0.6534	0.8083
0.4843	7.7681	536	0.6522	0.6594	0.6522	0.8076
0.4843	7.7971	538	0.6792	0.6845	0.6792	0.8242
0.4843	7.8261	540	0.8105	0.6756	0.8105	0.9003
0.4843	7.8551	542	0.9954	0.6073	0.9954	0.9977
0.4843	7.8841	544	1.1476	0.5503	1.1476	1.0713
0.4843	7.9130	546	1.1695	0.5354	1.1695	1.0814
0.4843	7.9420	548	1.0480	0.5683	1.0480	1.0237
0.4843	7.9710	550	0.9407	0.5869	0.9407	0.9699

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1