Arabic_FineTuningAraBERT_AugV5_k15_task3_organization_fold1

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7283
• Qwk: 0.1895
• Mse: 0.7283
• Rmse: 0.8534

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0312	2	3.0742	0.0494	3.0742	1.7533
No log	0.0625	4	1.7737	0.0	1.7737	1.3318
No log	0.0938	6	0.8600	0.0120	0.8600	0.9274
No log	0.125	8	0.6868	0.0	0.6868	0.8287
No log	0.1562	10	0.7743	-0.0820	0.7743	0.8799
No log	0.1875	12	0.7971	-0.0820	0.7971	0.8928
No log	0.2188	14	0.9606	0.0	0.9606	0.9801
No log	0.25	16	1.2230	0.0	1.2230	1.1059
No log	0.2812	18	1.2096	0.0	1.2096	1.0998
No log	0.3125	20	1.1852	0.0	1.1852	1.0887
No log	0.3438	22	0.9549	0.0120	0.9549	0.9772
No log	0.375	24	0.8684	0.0403	0.8684	0.9319
No log	0.4062	26	0.7789	-0.0820	0.7789	0.8826
No log	0.4375	28	0.8438	-0.0708	0.8438	0.9186
No log	0.4688	30	0.7596	-0.0820	0.7596	0.8715
No log	0.5	32	0.7132	0.1538	0.7132	0.8445
No log	0.5312	34	0.6919	0.4211	0.6919	0.8318
No log	0.5625	36	0.7100	0.0571	0.7100	0.8426
No log	0.5938	38	0.6780	0.0984	0.6780	0.8234
No log	0.625	40	0.7012	0.0403	0.7012	0.8374
No log	0.6562	42	0.7584	0.0253	0.7584	0.8709
No log	0.6875	44	0.7894	0.0120	0.7894	0.8885
No log	0.7188	46	0.6953	0.0253	0.6953	0.8338
No log	0.75	48	0.6658	0.3186	0.6658	0.8160
No log	0.7812	50	0.7712	0.0984	0.7712	0.8782
No log	0.8125	52	0.8239	0.0763	0.8239	0.9077
No log	0.8438	54	0.8952	0.0	0.8952	0.9462
No log	0.875	56	0.9632	0.0	0.9632	0.9814
No log	0.9062	58	1.0088	0.0	1.0088	1.0044
No log	0.9375	60	1.0667	0.0	1.0667	1.0328
No log	0.9688	62	1.1741	0.0	1.1741	1.0836
No log	1.0	64	1.0290	0.0	1.0290	1.0144
No log	1.0312	66	0.8218	0.0120	0.8218	0.9066
No log	1.0625	68	0.8363	0.0403	0.8363	0.9145
No log	1.0938	70	0.5300	0.3654	0.5300	0.7280
No log	1.125	72	0.5146	0.3654	0.5146	0.7173
No log	1.1562	74	0.9795	0.2434	0.9795	0.9897
No log	1.1875	76	1.0218	0.2434	1.0218	1.0109
No log	1.2188	78	0.9052	0.0403	0.9052	0.9514
No log	1.25	80	0.6781	0.0984	0.6781	0.8235
No log	1.2812	82	0.7259	0.2787	0.7259	0.8520
No log	1.3125	84	0.9518	0.0	0.9518	0.9756
No log	1.3438	86	1.1367	0.0	1.1367	1.0662
No log	1.375	88	1.3142	0.0	1.3142	1.1464
No log	1.4062	90	1.2566	0.0	1.2566	1.1210
No log	1.4375	92	1.0408	0.0120	1.0408	1.0202
No log	1.4688	94	0.8682	0.0403	0.8682	0.9318
No log	1.5	96	0.8824	0.0120	0.8824	0.9394
No log	1.5312	98	1.2363	0.0	1.2363	1.1119
No log	1.5625	100	1.5610	0.0	1.5610	1.2494
No log	1.5938	102	1.3651	0.0	1.3651	1.1684
No log	1.625	104	1.4170	0.0	1.4170	1.1904
No log	1.6562	106	1.4399	0.0120	1.4399	1.1999
No log	1.6875	108	1.0343	0.1646	1.0343	1.0170
No log	1.7188	110	0.7499	-0.0577	0.7499	0.8660
No log	1.75	112	0.6985	-0.0577	0.6985	0.8358
No log	1.7812	114	0.6891	0.0	0.6891	0.8301
No log	1.8125	116	0.7146	0.0	0.7146	0.8454
No log	1.8438	118	0.6523	0.0	0.6523	0.8077
No log	1.875	120	0.8645	0.2443	0.8645	0.9298
No log	1.9062	122	1.3580	0.0120	1.3580	1.1653
No log	1.9375	124	1.3853	0.0120	1.3853	1.1770
No log	1.9688	126	1.0685	0.1646	1.0685	1.0337
No log	2.0	128	0.6497	0.3186	0.6497	0.8060
No log	2.0312	130	0.6281	0.0	0.6281	0.7925
No log	2.0625	132	0.6540	0.0	0.6540	0.8087
No log	2.0938	134	0.6434	0.0	0.6434	0.8021
No log	2.125	136	0.6473	0.0	0.6473	0.8045
No log	2.1562	138	0.7870	0.2143	0.7870	0.8872
No log	2.1875	140	1.0707	0.0120	1.0707	1.0348
No log	2.2188	142	1.1795	0.0120	1.1795	1.0861
No log	2.25	144	0.9552	0.0120	0.9552	0.9773
No log	2.2812	146	0.6813	0.5133	0.6813	0.8254
No log	2.3125	148	0.6571	0.0	0.6571	0.8106
No log	2.3438	150	0.6852	0.0	0.6852	0.8278
No log	2.375	152	0.6848	0.0	0.6848	0.8275
No log	2.4062	154	0.6513	0.0	0.6513	0.8070
No log	2.4375	156	0.6311	0.2326	0.6311	0.7944
No log	2.4688	158	0.6553	0.1538	0.6553	0.8095
No log	2.5	160	0.8405	0.2443	0.8405	0.9168
No log	2.5312	162	1.0324	0.0120	1.0324	1.0161
No log	2.5625	164	1.1418	0.0120	1.1418	1.0685
No log	2.5938	166	1.0140	0.0120	1.0140	1.0070
No log	2.625	168	0.7884	0.2787	0.7884	0.8879
No log	2.6562	170	0.6439	-0.0233	0.6439	0.8024
No log	2.6875	172	0.6330	0.0	0.6330	0.7956
No log	2.7188	174	0.6400	0.0	0.6400	0.8000
No log	2.75	176	0.6422	0.0	0.6422	0.8014
No log	2.7812	178	0.6342	0.0	0.6342	0.7964
No log	2.8125	180	0.6158	0.0	0.6158	0.7847
No log	2.8438	182	0.5894	0.1895	0.5894	0.7677
No log	2.875	184	0.5644	0.1538	0.5644	0.7513
No log	2.9062	186	0.5558	0.2326	0.5558	0.7455
No log	2.9375	188	0.6000	0.0	0.6000	0.7746
No log	2.9688	190	0.5520	0.2326	0.5520	0.7429
No log	3.0	192	0.5219	0.1895	0.5219	0.7224
No log	3.0312	194	0.6203	0.1538	0.6203	0.7876
No log	3.0625	196	0.5895	0.1895	0.5895	0.7678
No log	3.0938	198	0.5501	0.1895	0.5501	0.7417
No log	3.125	200	0.5557	0.1895	0.5557	0.7454
No log	3.1562	202	0.5576	0.2326	0.5576	0.7467
No log	3.1875	204	0.5978	0.1895	0.5978	0.7732
No log	3.2188	206	0.7684	0.2361	0.7684	0.8766
No log	3.25	208	0.7256	0.3016	0.7256	0.8518
No log	3.2812	210	0.5887	0.2326	0.5887	0.7673
No log	3.3125	212	0.6023	0.2326	0.6023	0.7761
No log	3.3438	214	0.6415	0.2326	0.6415	0.8009
No log	3.375	216	0.6780	0.1895	0.6780	0.8234
No log	3.4062	218	0.7426	0.3016	0.7426	0.8617
No log	3.4375	220	0.7217	0.2878	0.7217	0.8495
No log	3.4688	222	0.6893	0.2222	0.6893	0.8303
No log	3.5	224	0.6967	0.2222	0.6967	0.8347
No log	3.5312	226	0.6557	0.2222	0.6557	0.8097
No log	3.5625	228	0.7092	0.2667	0.7092	0.8421
No log	3.5938	230	0.6965	0.2568	0.6965	0.8346
No log	3.625	232	0.6341	0.2143	0.6341	0.7963
No log	3.6562	234	0.6244	0.2326	0.6244	0.7902
No log	3.6875	236	0.6079	0.2326	0.6079	0.7797
No log	3.7188	238	0.6045	0.2326	0.6045	0.7775
No log	3.75	240	0.6760	0.1895	0.6760	0.8222
No log	3.7812	242	0.6921	0.1895	0.6921	0.8319
No log	3.8125	244	0.5854	0.2326	0.5854	0.7651
No log	3.8438	246	0.5972	0.2326	0.5972	0.7728
No log	3.875	248	0.5990	0.2326	0.5990	0.7739
No log	3.9062	250	0.5973	0.2326	0.5973	0.7729
No log	3.9375	252	0.7297	0.1895	0.7297	0.8542
No log	3.9688	254	0.9109	0.1037	0.9109	0.9544
No log	4.0	256	1.1617	-0.0829	1.1617	1.0778
No log	4.0312	258	1.0591	-0.2595	1.0591	1.0291
No log	4.0625	260	0.7528	-0.0577	0.7528	0.8676
No log	4.0938	262	0.6222	0.1895	0.6222	0.7888
No log	4.125	264	0.6026	0.2326	0.6026	0.7763
No log	4.1562	266	0.6457	0.1895	0.6457	0.8035
No log	4.1875	268	0.8358	-0.0708	0.8358	0.9142
No log	4.2188	270	0.9374	-0.0708	0.9374	0.9682
No log	4.25	272	0.8092	0.1895	0.8092	0.8995
No log	4.2812	274	0.7489	0.1895	0.7489	0.8654
No log	4.3125	276	0.7628	0.1895	0.7628	0.8734
No log	4.3438	278	0.7874	0.1895	0.7874	0.8874
No log	4.375	280	0.7843	0.1895	0.7843	0.8856
No log	4.4062	282	0.7821	0.1895	0.7821	0.8844
No log	4.4375	284	0.7474	0.1852	0.7474	0.8645
No log	4.4688	286	0.7021	0.1895	0.7021	0.8379
No log	4.5	288	0.6784	0.1895	0.6784	0.8236
No log	4.5312	290	0.6307	0.1895	0.6307	0.7942
No log	4.5625	292	0.6043	0.1895	0.6043	0.7773
No log	4.5938	294	0.5889	0.1895	0.5889	0.7674
No log	4.625	296	0.6042	0.1895	0.6042	0.7773
No log	4.6562	298	0.6460	0.1895	0.6460	0.8037
No log	4.6875	300	0.6379	0.1895	0.6379	0.7987
No log	4.7188	302	0.6026	0.1895	0.6026	0.7763
No log	4.75	304	0.5847	0.2326	0.5847	0.7647
No log	4.7812	306	0.5811	0.2326	0.5811	0.7623
No log	4.8125	308	0.6526	0.1895	0.6526	0.8078
No log	4.8438	310	0.7527	0.3016	0.7527	0.8676
No log	4.875	312	0.7619	0.3016	0.7619	0.8729
No log	4.9062	314	0.7076	0.1895	0.7076	0.8412
No log	4.9375	316	0.6918	0.2222	0.6918	0.8318
No log	4.9688	318	0.7485	0.3623	0.7485	0.8652
No log	5.0	320	0.7327	0.2143	0.7327	0.8560
No log	5.0312	322	0.7219	0.1895	0.7219	0.8497
No log	5.0625	324	0.7448	0.1895	0.7448	0.8630
No log	5.0938	326	0.6963	0.1895	0.6963	0.8345
No log	5.125	328	0.6816	0.1895	0.6816	0.8256
No log	5.1562	330	0.6864	0.1895	0.6864	0.8285
No log	5.1875	332	0.7968	-0.0708	0.7968	0.8926
No log	5.2188	334	0.8250	-0.0708	0.8250	0.9083
No log	5.25	336	0.7404	0.1895	0.7404	0.8605
No log	5.2812	338	0.6551	0.1895	0.6551	0.8094
No log	5.3125	340	0.6445	0.1895	0.6445	0.8028
No log	5.3438	342	0.7041	0.1895	0.7041	0.8391
No log	5.375	344	0.7841	-0.0577	0.7841	0.8855
No log	5.4062	346	0.7145	0.1895	0.7145	0.8453
No log	5.4375	348	0.6922	0.1895	0.6922	0.8320
No log	5.4688	350	0.7386	0.1852	0.7386	0.8594
No log	5.5	352	0.8410	-0.0342	0.8410	0.9170
No log	5.5312	354	0.8425	0.1852	0.8425	0.9179
No log	5.5625	356	0.8699	0.1081	0.8699	0.9327
No log	5.5938	358	0.9647	0.0833	0.9647	0.9822
No log	5.625	360	1.0547	0.0494	1.0547	1.0270
No log	5.6562	362	1.0045	0.0654	1.0045	1.0023
No log	5.6875	364	0.8857	0.0833	0.8857	0.9411
No log	5.7188	366	0.8047	0.3016	0.8047	0.8970
No log	5.75	368	0.8535	0.0833	0.8535	0.9238
No log	5.7812	370	0.9555	0.0833	0.9555	0.9775
No log	5.8125	372	0.9318	0.0833	0.9318	0.9653
No log	5.8438	374	0.9295	0.0833	0.9295	0.9641
No log	5.875	376	0.8608	0.0833	0.8608	0.9278
No log	5.9062	378	0.8421	0.0833	0.8421	0.9177
No log	5.9375	380	0.8580	0.0833	0.8580	0.9263
No log	5.9688	382	0.8842	0.0833	0.8842	0.9403
No log	6.0	384	0.8003	0.3016	0.8003	0.8946
No log	6.0312	386	0.7444	0.1895	0.7444	0.8628
No log	6.0625	388	0.7051	0.1895	0.7051	0.8397
No log	6.0938	390	0.6992	0.1895	0.6992	0.8362
No log	6.125	392	0.7241	0.1895	0.7241	0.8509
No log	6.1562	394	0.7470	0.1895	0.7470	0.8643
No log	6.1875	396	0.7289	0.1895	0.7289	0.8537
No log	6.2188	398	0.6731	0.1895	0.6731	0.8204
No log	6.25	400	0.6825	0.1895	0.6825	0.8262
No log	6.2812	402	0.6995	0.1895	0.6995	0.8363
No log	6.3125	404	0.6873	0.1895	0.6873	0.8290
No log	6.3438	406	0.6973	0.1895	0.6973	0.8350
No log	6.375	408	0.7025	0.1895	0.7025	0.8382
No log	6.4062	410	0.6421	0.1895	0.6421	0.8013
No log	6.4375	412	0.6118	0.1895	0.6118	0.7822
No log	6.4688	414	0.6043	0.1852	0.6043	0.7774
No log	6.5	416	0.5979	0.2222	0.5979	0.7732
No log	6.5312	418	0.6041	0.1895	0.6041	0.7772
No log	6.5625	420	0.6821	0.1895	0.6821	0.8259
No log	6.5938	422	0.7775	0.1538	0.7775	0.8818
No log	6.625	424	0.7574	0.1895	0.7574	0.8703
No log	6.6562	426	0.6728	0.1895	0.6728	0.8203
No log	6.6875	428	0.6493	0.1895	0.6493	0.8058
No log	6.7188	430	0.6598	0.1895	0.6598	0.8123
No log	6.75	432	0.6717	0.1895	0.6717	0.8196
No log	6.7812	434	0.7091	0.1895	0.7091	0.8421
No log	6.8125	436	0.7813	0.1895	0.7813	0.8839
No log	6.8438	438	0.8572	-0.0708	0.8572	0.9258
No log	6.875	440	0.8620	-0.0708	0.8620	0.9285
No log	6.9062	442	0.8073	0.1538	0.8073	0.8985
No log	6.9375	444	0.7138	0.1895	0.7138	0.8448
No log	6.9688	446	0.6484	0.1895	0.6484	0.8053
No log	7.0	448	0.6423	0.1895	0.6423	0.8014
No log	7.0312	450	0.6814	0.1895	0.6814	0.8255
No log	7.0625	452	0.7058	0.1895	0.7058	0.8401
No log	7.0938	454	0.7135	0.1895	0.7135	0.8447
No log	7.125	456	0.7220	0.1895	0.7220	0.8497
No log	7.1562	458	0.7112	0.1895	0.7112	0.8433
No log	7.1875	460	0.6648	0.1895	0.6648	0.8153
No log	7.2188	462	0.6269	0.1895	0.6269	0.7918
No log	7.25	464	0.6121	0.2326	0.6121	0.7824
No log	7.2812	466	0.6085	0.2326	0.6085	0.7801
No log	7.3125	468	0.6088	0.2326	0.6088	0.7802
No log	7.3438	470	0.6241	0.1895	0.6241	0.7900
No log	7.375	472	0.7005	0.1895	0.7005	0.8369
No log	7.4062	474	0.7854	0.1538	0.7854	0.8862
No log	7.4375	476	0.8227	-0.0708	0.8227	0.9070
No log	7.4688	478	0.7708	0.1895	0.7708	0.8779
No log	7.5	480	0.6979	0.1895	0.6979	0.8354
No log	7.5312	482	0.6626	0.1895	0.6626	0.8140
No log	7.5625	484	0.6704	0.1895	0.6704	0.8188
No log	7.5938	486	0.7067	0.1895	0.7067	0.8406
No log	7.625	488	0.7552	0.1895	0.7552	0.8690
No log	7.6562	490	0.7816	0.1895	0.7816	0.8841
No log	7.6875	492	0.7876	0.1895	0.7876	0.8875
No log	7.7188	494	0.8119	0.1895	0.8119	0.9010
No log	7.75	496	0.8642	0.0833	0.8642	0.9296
No log	7.7812	498	0.8595	-0.0708	0.8595	0.9271
0.4694	7.8125	500	0.8270	-0.0577	0.8270	0.9094
0.4694	7.8438	502	0.8180	-0.0577	0.8180	0.9044
0.4694	7.875	504	0.8098	-0.0577	0.8098	0.8999
0.4694	7.9062	506	0.7509	0.1895	0.7509	0.8666
0.4694	7.9375	508	0.6835	0.1895	0.6835	0.8267
0.4694	7.9688	510	0.6326	0.1895	0.6326	0.7954
0.4694	8.0	512	0.6225	0.1895	0.6225	0.7890
0.4694	8.0312	514	0.6343	0.1895	0.6343	0.7964
0.4694	8.0625	516	0.6688	0.1895	0.6688	0.8178
0.4694	8.0938	518	0.7127	0.1895	0.7127	0.8442
0.4694	8.125	520	0.7559	0.1895	0.7559	0.8694
0.4694	8.1562	522	0.7686	0.1895	0.7686	0.8767
0.4694	8.1875	524	0.7417	0.1895	0.7417	0.8612
0.4694	8.2188	526	0.7129	0.1895	0.7129	0.8443
0.4694	8.25	528	0.6919	0.1895	0.6919	0.8318
0.4694	8.2812	530	0.6682	0.1895	0.6682	0.8174
0.4694	8.3125	532	0.6616	0.1895	0.6616	0.8134
0.4694	8.3438	534	0.6617	0.1895	0.6617	0.8135
0.4694	8.375	536	0.6674	0.1895	0.6674	0.8169
0.4694	8.4062	538	0.6835	0.1895	0.6835	0.8268
0.4694	8.4375	540	0.7149	0.1895	0.7149	0.8455
0.4694	8.4688	542	0.7545	0.1895	0.7545	0.8686
0.4694	8.5	544	0.7588	0.1895	0.7588	0.8711
0.4694	8.5312	546	0.7393	0.1895	0.7393	0.8598
0.4694	8.5625	548	0.7433	0.1895	0.7433	0.8622
0.4694	8.5938	550	0.7735	0.1895	0.7735	0.8795
0.4694	8.625	552	0.7776	0.1895	0.7776	0.8818
0.4694	8.6562	554	0.7884	0.1895	0.7884	0.8879
0.4694	8.6875	556	0.7829	0.1895	0.7829	0.8848
0.4694	8.7188	558	0.7572	0.1895	0.7572	0.8701
0.4694	8.75	560	0.7317	0.1895	0.7317	0.8554
0.4694	8.7812	562	0.7193	0.1895	0.7193	0.8481
0.4694	8.8125	564	0.7127	0.1895	0.7127	0.8442
0.4694	8.8438	566	0.7137	0.1895	0.7137	0.8448
0.4694	8.875	568	0.7220	0.1895	0.7220	0.8497
0.4694	8.9062	570	0.7303	0.1895	0.7303	0.8546
0.4694	8.9375	572	0.7409	0.1895	0.7409	0.8608
0.4694	8.9688	574	0.7496	0.1895	0.7496	0.8658
0.4694	9.0	576	0.7489	0.1895	0.7489	0.8654
0.4694	9.0312	578	0.7492	0.1895	0.7492	0.8656
0.4694	9.0625	580	0.7542	0.1895	0.7542	0.8685
0.4694	9.0938	582	0.7537	0.1895	0.7537	0.8682
0.4694	9.125	584	0.7506	0.1895	0.7506	0.8663
0.4694	9.1562	586	0.7474	0.1895	0.7474	0.8645
0.4694	9.1875	588	0.7503	0.1895	0.7503	0.8662
0.4694	9.2188	590	0.7560	0.1895	0.7560	0.8695
0.4694	9.25	592	0.7653	0.1895	0.7653	0.8748
0.4694	9.2812	594	0.7738	0.1895	0.7738	0.8797
0.4694	9.3125	596	0.7730	0.1895	0.7730	0.8792
0.4694	9.3438	598	0.7612	0.1895	0.7612	0.8725
0.4694	9.375	600	0.7423	0.1895	0.7423	0.8616
0.4694	9.4062	602	0.7237	0.1895	0.7237	0.8507
0.4694	9.4375	604	0.7156	0.1895	0.7156	0.8459
0.4694	9.4688	606	0.7196	0.1895	0.7196	0.8483
0.4694	9.5	608	0.7160	0.1895	0.7160	0.8462
0.4694	9.5312	610	0.7108	0.1895	0.7108	0.8431
0.4694	9.5625	612	0.7023	0.1895	0.7023	0.8380
0.4694	9.5938	614	0.6956	0.1895	0.6956	0.8340
0.4694	9.625	616	0.6959	0.1895	0.6959	0.8342
0.4694	9.6562	618	0.7003	0.1895	0.7003	0.8368
0.4694	9.6875	620	0.7065	0.1895	0.7065	0.8405
0.4694	9.7188	622	0.7097	0.1895	0.7097	0.8424
0.4694	9.75	624	0.7109	0.1895	0.7109	0.8431
0.4694	9.7812	626	0.7142	0.1895	0.7142	0.8451
0.4694	9.8125	628	0.7166	0.1895	0.7166	0.8465
0.4694	9.8438	630	0.7192	0.1895	0.7192	0.8480
0.4694	9.875	632	0.7215	0.1895	0.7215	0.8494
0.4694	9.9062	634	0.7245	0.1895	0.7245	0.8512
0.4694	9.9375	636	0.7267	0.1895	0.7267	0.8525
0.4694	9.9688	638	0.7280	0.1895	0.7280	0.8532
0.4694	10.0	640	0.7283	0.1895	0.7283	0.8534

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1