ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run2_AugV5_k3_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6352
• Qwk: 0.5361
• Mse: 0.6352
• Rmse: 0.7970

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1818	2	3.8235	-0.0282	3.8235	1.9554
No log	0.3636	4	1.9361	0.0219	1.9361	1.3914
No log	0.5455	6	1.2324	0.0201	1.2324	1.1101
No log	0.7273	8	1.3362	-0.0428	1.3362	1.1560
No log	0.9091	10	1.2032	0.0700	1.2032	1.0969
No log	1.0909	12	1.3002	-0.0311	1.3002	1.1403
No log	1.2727	14	1.5652	0.1928	1.5652	1.2511
No log	1.4545	16	1.4066	0.1085	1.4066	1.1860
No log	1.6364	18	1.9234	0.1558	1.9234	1.3869
No log	1.8182	20	1.9006	0.1994	1.9006	1.3786
No log	2.0	22	1.1813	0.1438	1.1813	1.0869
No log	2.1818	24	0.8411	0.4660	0.8411	0.9171
No log	2.3636	26	0.8282	0.5054	0.8282	0.9101
No log	2.5455	28	0.9662	0.2070	0.9662	0.9830
No log	2.7273	30	1.0793	0.2203	1.0793	1.0389
No log	2.9091	32	1.0878	0.2598	1.0878	1.0430
No log	3.0909	34	1.0662	0.3268	1.0662	1.0326
No log	3.2727	36	0.8863	0.4361	0.8863	0.9414
No log	3.4545	38	0.7757	0.5102	0.7757	0.8808
No log	3.6364	40	0.7961	0.5421	0.7961	0.8923
No log	3.8182	42	1.0786	0.4272	1.0786	1.0386
No log	4.0	44	1.2181	0.4100	1.2181	1.1037
No log	4.1818	46	0.9724	0.4874	0.9724	0.9861
No log	4.3636	48	0.8082	0.4885	0.8082	0.8990
No log	4.5455	50	0.8321	0.5257	0.8321	0.9122
No log	4.7273	52	0.8313	0.5090	0.8313	0.9118
No log	4.9091	54	1.2295	0.3964	1.2295	1.1088
No log	5.0909	56	1.1692	0.4228	1.1692	1.0813
No log	5.2727	58	0.8592	0.4884	0.8592	0.9269
No log	5.4545	60	0.7977	0.4526	0.7977	0.8931
No log	5.6364	62	0.8214	0.5175	0.8214	0.9063
No log	5.8182	64	0.7761	0.4305	0.7761	0.8810
No log	6.0	66	0.8277	0.5653	0.8277	0.9098
No log	6.1818	68	0.9754	0.4761	0.9754	0.9876
No log	6.3636	70	0.8518	0.5232	0.8518	0.9229
No log	6.5455	72	0.7147	0.5786	0.7147	0.8454
No log	6.7273	74	0.7593	0.5052	0.7593	0.8714
No log	6.9091	76	0.7059	0.5786	0.7059	0.8402
No log	7.0909	78	0.7105	0.5726	0.7105	0.8429
No log	7.2727	80	0.7829	0.5665	0.7829	0.8848
No log	7.4545	82	0.7634	0.5665	0.7634	0.8737
No log	7.6364	84	0.6560	0.5955	0.6560	0.8099
No log	7.8182	86	0.7154	0.5751	0.7154	0.8458
No log	8.0	88	0.7361	0.5707	0.7361	0.8579
No log	8.1818	90	0.6228	0.6398	0.6228	0.7892
No log	8.3636	92	0.7488	0.6246	0.7488	0.8653
No log	8.5455	94	0.7375	0.6266	0.7375	0.8588
No log	8.7273	96	0.6190	0.6796	0.6190	0.7868
No log	8.9091	98	0.6301	0.5866	0.6301	0.7938
No log	9.0909	100	0.6380	0.5961	0.6380	0.7988
No log	9.2727	102	0.6773	0.6184	0.6773	0.8230
No log	9.4545	104	0.6458	0.5046	0.6458	0.8036
No log	9.6364	106	0.6738	0.5992	0.6738	0.8209
No log	9.8182	108	0.6936	0.5872	0.6936	0.8328
No log	10.0	110	0.6766	0.4515	0.6766	0.8226
No log	10.1818	112	0.7245	0.5865	0.7245	0.8512
No log	10.3636	114	0.7082	0.5650	0.7082	0.8415
No log	10.5455	116	0.6865	0.4745	0.6865	0.8286
No log	10.7273	118	0.7277	0.5540	0.7277	0.8531
No log	10.9091	120	0.6711	0.5605	0.6711	0.8192
No log	11.0909	122	0.7261	0.6055	0.7261	0.8521
No log	11.2727	124	0.8405	0.5525	0.8405	0.9168
No log	11.4545	126	0.7256	0.6013	0.7256	0.8518
No log	11.6364	128	0.6462	0.6241	0.6462	0.8039
No log	11.8182	130	0.7347	0.5902	0.7347	0.8572
No log	12.0	132	0.7068	0.5416	0.7068	0.8407
No log	12.1818	134	0.6481	0.5811	0.6481	0.8050
No log	12.3636	136	0.6520	0.5127	0.6520	0.8075
No log	12.5455	138	0.6580	0.5477	0.6580	0.8112
No log	12.7273	140	0.6520	0.6143	0.6520	0.8074
No log	12.9091	142	0.6463	0.5822	0.6463	0.8040
No log	13.0909	144	0.6588	0.6124	0.6588	0.8117
No log	13.2727	146	0.6646	0.5845	0.6646	0.8152
No log	13.4545	148	0.6534	0.6032	0.6534	0.8083
No log	13.6364	150	0.6494	0.6092	0.6494	0.8059
No log	13.8182	152	0.6474	0.6291	0.6474	0.8046
No log	14.0	154	0.6632	0.6440	0.6632	0.8144
No log	14.1818	156	0.6731	0.6586	0.6731	0.8204
No log	14.3636	158	0.6422	0.6876	0.6422	0.8014
No log	14.5455	160	0.6274	0.6796	0.6274	0.7921
No log	14.7273	162	0.6310	0.6969	0.6310	0.7944
No log	14.9091	164	0.6343	0.6940	0.6343	0.7964
No log	15.0909	166	0.6377	0.6500	0.6377	0.7986
No log	15.2727	168	0.6380	0.6415	0.6380	0.7987
No log	15.4545	170	0.6325	0.6770	0.6325	0.7953
No log	15.6364	172	0.6422	0.6593	0.6422	0.8014
No log	15.8182	174	0.7077	0.6045	0.7077	0.8413
No log	16.0	176	0.7207	0.5847	0.7207	0.8490
No log	16.1818	178	0.6768	0.6636	0.6768	0.8227
No log	16.3636	180	0.6627	0.6306	0.6627	0.8141
No log	16.5455	182	0.6867	0.6358	0.6867	0.8286
No log	16.7273	184	0.7593	0.5440	0.7593	0.8714
No log	16.9091	186	0.7481	0.5625	0.7481	0.8649
No log	17.0909	188	0.6882	0.6144	0.6882	0.8296
No log	17.2727	190	0.6554	0.5866	0.6554	0.8096
No log	17.4545	192	0.6512	0.5774	0.6512	0.8070
No log	17.6364	194	0.6229	0.6197	0.6229	0.7892
No log	17.8182	196	0.6448	0.5638	0.6448	0.8030
No log	18.0	198	0.6736	0.5783	0.6736	0.8207
No log	18.1818	200	0.6802	0.5783	0.6802	0.8247
No log	18.3636	202	0.6420	0.5882	0.6420	0.8013
No log	18.5455	204	0.6325	0.5536	0.6325	0.7953
No log	18.7273	206	0.6529	0.5530	0.6529	0.8080
No log	18.9091	208	0.6605	0.5748	0.6605	0.8127
No log	19.0909	210	0.6477	0.5882	0.6477	0.8048
No log	19.2727	212	0.6360	0.5522	0.6360	0.7975
No log	19.4545	214	0.6431	0.5377	0.6431	0.8019
No log	19.6364	216	0.6464	0.5153	0.6464	0.8040
No log	19.8182	218	0.6686	0.5771	0.6686	0.8177
No log	20.0	220	0.6668	0.6052	0.6668	0.8166
No log	20.1818	222	0.6412	0.6133	0.6412	0.8007
No log	20.3636	224	0.6423	0.6500	0.6423	0.8014
No log	20.5455	226	0.6366	0.6916	0.6366	0.7979
No log	20.7273	228	0.7009	0.6606	0.7009	0.8372
No log	20.9091	230	0.7894	0.5520	0.7894	0.8885
No log	21.0909	232	0.7373	0.5998	0.7373	0.8587
No log	21.2727	234	0.6385	0.6456	0.6385	0.7991
No log	21.4545	236	0.6508	0.5964	0.6508	0.8067
No log	21.6364	238	0.6550	0.5787	0.6550	0.8093
No log	21.8182	240	0.6532	0.5260	0.6532	0.8082
No log	22.0	242	0.7002	0.6089	0.7002	0.8368
No log	22.1818	244	0.7470	0.5739	0.7470	0.8643
No log	22.3636	246	0.6900	0.6418	0.6900	0.8306
No log	22.5455	248	0.6359	0.6133	0.6359	0.7975
No log	22.7273	250	0.6350	0.5455	0.6350	0.7969
No log	22.9091	252	0.6507	0.5787	0.6507	0.8067
No log	23.0909	254	0.6254	0.5572	0.6254	0.7908
No log	23.2727	256	0.6157	0.5771	0.6157	0.7847
No log	23.4545	258	0.6275	0.5436	0.6275	0.7922
No log	23.6364	260	0.6104	0.5677	0.6104	0.7813
No log	23.8182	262	0.6005	0.5536	0.6005	0.7749
No log	24.0	264	0.5968	0.5850	0.5968	0.7725
No log	24.1818	266	0.5993	0.6062	0.5993	0.7741
No log	24.3636	268	0.5991	0.6846	0.5991	0.7740
No log	24.5455	270	0.6623	0.5860	0.6623	0.8138
No log	24.7273	272	0.7111	0.5565	0.7111	0.8432
No log	24.9091	274	0.6570	0.5686	0.6570	0.8106
No log	25.0909	276	0.6136	0.6105	0.6136	0.7834
No log	25.2727	278	0.6422	0.5698	0.6422	0.8014
No log	25.4545	280	0.6341	0.5477	0.6341	0.7963
No log	25.6364	282	0.6318	0.5898	0.6318	0.7948
No log	25.8182	284	0.7070	0.5686	0.7070	0.8408
No log	26.0	286	0.7772	0.4700	0.7772	0.8816
No log	26.1818	288	0.7524	0.4671	0.7524	0.8674
No log	26.3636	290	0.7309	0.4845	0.7309	0.8549
No log	26.5455	292	0.6738	0.5195	0.6738	0.8208
No log	26.7273	294	0.6437	0.5153	0.6437	0.8023
No log	26.9091	296	0.6297	0.5734	0.6297	0.7936
No log	27.0909	298	0.6167	0.6479	0.6167	0.7853
No log	27.2727	300	0.6714	0.6232	0.6714	0.8194
No log	27.4545	302	0.7434	0.5843	0.7434	0.8622
No log	27.6364	304	0.7353	0.5770	0.7353	0.8575
No log	27.8182	306	0.6760	0.5890	0.6760	0.8222
No log	28.0	308	0.6388	0.5422	0.6388	0.7993
No log	28.1818	310	0.6377	0.5640	0.6377	0.7986
No log	28.3636	312	0.6330	0.5618	0.6330	0.7956
No log	28.5455	314	0.6206	0.5989	0.6206	0.7878
No log	28.7273	316	0.6098	0.5874	0.6098	0.7809
No log	28.9091	318	0.6057	0.7003	0.6057	0.7783
No log	29.0909	320	0.6243	0.6753	0.6243	0.7901
No log	29.2727	322	0.6562	0.6444	0.6562	0.8100
No log	29.4545	324	0.6381	0.6334	0.6381	0.7988
No log	29.6364	326	0.6255	0.6198	0.6255	0.7909
No log	29.8182	328	0.6517	0.5869	0.6517	0.8073
No log	30.0	330	0.6879	0.5614	0.6879	0.8294
No log	30.1818	332	0.6685	0.5751	0.6685	0.8176
No log	30.3636	334	0.6445	0.6175	0.6445	0.8028
No log	30.5455	336	0.6525	0.6564	0.6525	0.8078
No log	30.7273	338	0.6583	0.6564	0.6583	0.8113
No log	30.9091	340	0.6526	0.6302	0.6526	0.8079
No log	31.0909	342	0.6671	0.5902	0.6671	0.8168
No log	31.2727	344	0.6661	0.5821	0.6661	0.8162
No log	31.4545	346	0.6519	0.6013	0.6519	0.8074
No log	31.6364	348	0.6588	0.5436	0.6588	0.8117
No log	31.8182	350	0.6616	0.5316	0.6616	0.8134
No log	32.0	352	0.6376	0.6317	0.6376	0.7985
No log	32.1818	354	0.6213	0.6433	0.6213	0.7882
No log	32.3636	356	0.6176	0.6772	0.6176	0.7859
No log	32.5455	358	0.6191	0.6675	0.6191	0.7868
No log	32.7273	360	0.6329	0.6850	0.6329	0.7956
No log	32.9091	362	0.6525	0.6330	0.6525	0.8078
No log	33.0909	364	0.6347	0.6344	0.6347	0.7967
No log	33.2727	366	0.6247	0.6602	0.6247	0.7904
No log	33.4545	368	0.6218	0.6634	0.6218	0.7885
No log	33.6364	370	0.6288	0.6217	0.6288	0.7930
No log	33.8182	372	0.6283	0.6217	0.6283	0.7927
No log	34.0	374	0.6369	0.5890	0.6369	0.7981
No log	34.1818	376	0.6172	0.6526	0.6172	0.7856
No log	34.3636	378	0.6062	0.6796	0.6062	0.7786
No log	34.5455	380	0.6082	0.6681	0.6082	0.7799
No log	34.7273	382	0.6067	0.6932	0.6067	0.7789
No log	34.9091	384	0.6083	0.7064	0.6083	0.7799
No log	35.0909	386	0.6153	0.7064	0.6153	0.7844
No log	35.2727	388	0.6164	0.6650	0.6164	0.7851
No log	35.4545	390	0.6076	0.6903	0.6076	0.7795
No log	35.6364	392	0.6280	0.6911	0.6280	0.7925
No log	35.8182	394	0.6852	0.5770	0.6852	0.8278
No log	36.0	396	0.7002	0.5362	0.7002	0.8368
No log	36.1818	398	0.6565	0.5566	0.6565	0.8103
No log	36.3636	400	0.6176	0.6606	0.6176	0.7859
No log	36.5455	402	0.6276	0.5676	0.6276	0.7922
No log	36.7273	404	0.6232	0.5774	0.6232	0.7894
No log	36.9091	406	0.5981	0.6788	0.5981	0.7733
No log	37.0909	408	0.5891	0.6442	0.5891	0.7675
No log	37.2727	410	0.5887	0.6564	0.5887	0.7673
No log	37.4545	412	0.5864	0.6733	0.5864	0.7658
No log	37.6364	414	0.5875	0.6733	0.5875	0.7665
No log	37.8182	416	0.5959	0.6427	0.5959	0.7719
No log	38.0	418	0.6190	0.5650	0.6190	0.7867
No log	38.1818	420	0.6661	0.5127	0.6661	0.8162
No log	38.3636	422	0.6574	0.5242	0.6574	0.8108
No log	38.5455	424	0.6198	0.5879	0.6198	0.7873
No log	38.7273	426	0.5982	0.6292	0.5982	0.7734
No log	38.9091	428	0.5979	0.6307	0.5979	0.7733
No log	39.0909	430	0.6117	0.6292	0.6117	0.7821
No log	39.2727	432	0.6270	0.5879	0.6270	0.7918
No log	39.4545	434	0.6104	0.6625	0.6104	0.7813
No log	39.6364	436	0.6060	0.6690	0.6060	0.7785
No log	39.8182	438	0.6134	0.6672	0.6134	0.7832
No log	40.0	440	0.6091	0.6479	0.6091	0.7805
No log	40.1818	442	0.6165	0.6919	0.6165	0.7852
No log	40.3636	444	0.6207	0.6919	0.6207	0.7878
No log	40.5455	446	0.6106	0.6778	0.6106	0.7814
No log	40.7273	448	0.6063	0.6507	0.6063	0.7787
No log	40.9091	450	0.6163	0.6296	0.6163	0.7851
No log	41.0909	452	0.6173	0.6296	0.6173	0.7857
No log	41.2727	454	0.6113	0.6681	0.6113	0.7818
No log	41.4545	456	0.5992	0.6737	0.5992	0.7741
No log	41.6364	458	0.6015	0.6884	0.6015	0.7755
No log	41.8182	460	0.6075	0.6214	0.6075	0.7794
No log	42.0	462	0.6142	0.5926	0.6142	0.7837
No log	42.1818	464	0.6085	0.6042	0.6085	0.7801
No log	42.3636	466	0.6072	0.6317	0.6072	0.7792
No log	42.5455	468	0.6059	0.6317	0.6059	0.7784
No log	42.7273	470	0.6061	0.5783	0.6061	0.7785
No log	42.9091	472	0.6108	0.5568	0.6108	0.7815
No log	43.0909	474	0.6136	0.5568	0.6136	0.7833
No log	43.2727	476	0.6055	0.5783	0.6055	0.7781
No log	43.4545	478	0.5946	0.6207	0.5946	0.7711
No log	43.6364	480	0.6004	0.6054	0.6004	0.7749
No log	43.8182	482	0.6074	0.5949	0.6074	0.7793
No log	44.0	484	0.6009	0.6370	0.6009	0.7752
No log	44.1818	486	0.5920	0.6262	0.5920	0.7694
No log	44.3636	488	0.5880	0.6370	0.5880	0.7668
No log	44.5455	490	0.5920	0.6370	0.5920	0.7694
No log	44.7273	492	0.5885	0.6370	0.5885	0.7672
No log	44.9091	494	0.5838	0.6658	0.5838	0.7641
No log	45.0909	496	0.5823	0.6452	0.5823	0.7631
No log	45.2727	498	0.5816	0.6690	0.5816	0.7626
0.1913	45.4545	500	0.5889	0.6715	0.5889	0.7674
0.1913	45.6364	502	0.5992	0.5949	0.5992	0.7741
0.1913	45.8182	504	0.6115	0.5949	0.6115	0.7820
0.1913	46.0	506	0.6233	0.5823	0.6233	0.7895
0.1913	46.1818	508	0.6415	0.5937	0.6415	0.8010
0.1913	46.3636	510	0.6352	0.5361	0.6352	0.7970

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1