ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run1_AugV5_k18_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9327
• Qwk: 0.6267
• Mse: 0.9327
• Rmse: 0.9658

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0233	2	7.4506	-0.0162	7.4506	2.7296
No log	0.0465	4	5.0879	0.0	5.0879	2.2556
No log	0.0698	6	3.5557	-0.0437	3.5557	1.8856
No log	0.0930	8	2.6568	0.0986	2.6568	1.6300
No log	0.1163	10	3.4197	-0.0714	3.4196	1.8492
No log	0.1395	12	2.8883	0.0400	2.8883	1.6995
No log	0.1628	14	2.0836	0.1221	2.0836	1.4435
No log	0.1860	16	1.7148	0.1495	1.7148	1.3095
No log	0.2093	18	1.7970	0.1524	1.7970	1.3405
No log	0.2326	20	1.6758	0.1509	1.6758	1.2945
No log	0.2558	22	1.7978	0.3387	1.7978	1.3408
No log	0.2791	24	2.3267	0.0811	2.3267	1.5254
No log	0.3023	26	2.2270	0.1517	2.2270	1.4923
No log	0.3256	28	1.8613	0.2901	1.8613	1.3643
No log	0.3488	30	1.7992	0.3577	1.7992	1.3414
No log	0.3721	32	2.0314	0.2656	2.0314	1.4253
No log	0.3953	34	2.0630	0.2121	2.0630	1.4363
No log	0.4186	36	2.0018	0.2519	2.0018	1.4148
No log	0.4419	38	1.9184	0.2901	1.9184	1.3851
No log	0.4651	40	1.8284	0.3077	1.8284	1.3522
No log	0.4884	42	1.8014	0.3206	1.8014	1.3422
No log	0.5116	44	1.6333	0.3594	1.6333	1.2780
No log	0.5349	46	1.5061	0.3252	1.5061	1.2272
No log	0.5581	48	1.5688	0.3387	1.5688	1.2525
No log	0.5814	50	1.7530	0.3016	1.7530	1.3240
No log	0.6047	52	1.8535	0.3857	1.8535	1.3614
No log	0.6279	54	2.0193	0.4125	2.0193	1.4210
No log	0.6512	56	1.9851	0.4125	1.9851	1.4089
No log	0.6744	58	1.6790	0.4167	1.6790	1.2958
No log	0.6977	60	1.5641	0.3438	1.5641	1.2507
No log	0.7209	62	1.5565	0.3492	1.5565	1.2476
No log	0.7442	64	1.6040	0.3885	1.6040	1.2665
No log	0.7674	66	1.6265	0.4056	1.6265	1.2753
No log	0.7907	68	1.8382	0.4444	1.8382	1.3558
No log	0.8140	70	2.0407	0.3879	2.0407	1.4285
No log	0.8372	72	1.6998	0.3662	1.6998	1.3038
No log	0.8605	74	1.4581	0.4242	1.4581	1.2075
No log	0.8837	76	1.3607	0.4651	1.3607	1.1665
No log	0.9070	78	1.4716	0.4651	1.4716	1.2131
No log	0.9302	80	1.5093	0.4545	1.5093	1.2285
No log	0.9535	82	1.5779	0.4211	1.5779	1.2561
No log	0.9767	84	1.6541	0.3571	1.6541	1.2861
No log	1.0	86	1.5492	0.4	1.5492	1.2447
No log	1.0233	88	1.4954	0.4211	1.4954	1.2229
No log	1.0465	90	1.4740	0.4211	1.4740	1.2141
No log	1.0698	92	1.5897	0.3852	1.5897	1.2608
No log	1.0930	94	1.6915	0.3662	1.6915	1.3006
No log	1.1163	96	1.7092	0.3662	1.7092	1.3074
No log	1.1395	98	1.9768	0.3636	1.9768	1.4060
No log	1.1628	100	1.7141	0.3889	1.7141	1.3093
No log	1.1860	102	1.4122	0.4511	1.4122	1.1884
No log	1.2093	104	1.2404	0.5455	1.2404	1.1137
No log	1.2326	106	1.2960	0.5	1.2960	1.1384
No log	1.2558	108	1.5215	0.3817	1.5215	1.2335
No log	1.2791	110	1.6980	0.4088	1.6980	1.3031
No log	1.3023	112	1.7560	0.4231	1.7560	1.3251
No log	1.3256	114	1.6365	0.4551	1.6365	1.2793
No log	1.3488	116	1.5626	0.4767	1.5626	1.2500
No log	1.3721	118	1.7804	0.4565	1.7804	1.3343
No log	1.3953	120	1.4410	0.4691	1.4410	1.2004
No log	1.4186	122	1.2977	0.5101	1.2977	1.1392
No log	1.4419	124	1.0236	0.6087	1.0236	1.0118
No log	1.4651	126	0.8915	0.6571	0.8915	0.9442
No log	1.4884	128	0.7955	0.6667	0.7955	0.8919
No log	1.5116	130	0.7980	0.7397	0.7980	0.8933
No log	1.5349	132	0.9003	0.7152	0.9003	0.9488
No log	1.5581	134	1.2995	0.5730	1.2995	1.1400
No log	1.5814	136	1.6346	0.5134	1.6346	1.2785
No log	1.6047	138	1.6094	0.5326	1.6094	1.2686
No log	1.6279	140	1.3096	0.5032	1.3096	1.1444
No log	1.6512	142	1.2372	0.5379	1.2372	1.1123
No log	1.6744	144	1.0542	0.6056	1.0542	1.0268
No log	1.6977	146	0.8995	0.6853	0.8995	0.9484
No log	1.7209	148	0.8478	0.6715	0.8478	0.9208
No log	1.7442	150	0.8516	0.6849	0.8516	0.9228
No log	1.7674	152	0.9251	0.6531	0.9251	0.9618
No log	1.7907	154	1.1829	0.5917	1.1829	1.0876
No log	1.8140	156	1.5747	0.5745	1.5747	1.2549
No log	1.8372	158	1.6861	0.5185	1.6861	1.2985
No log	1.8605	160	1.3766	0.5934	1.3766	1.1733
No log	1.8837	162	1.0610	0.6514	1.0610	1.0300
No log	1.9070	164	0.8039	0.7190	0.8039	0.8966
No log	1.9302	166	0.7789	0.7015	0.7789	0.8825
No log	1.9535	168	0.8685	0.6866	0.8685	0.9319
No log	1.9767	170	0.9288	0.6466	0.9288	0.9637
No log	2.0	172	0.9854	0.6107	0.9854	0.9927
No log	2.0233	174	0.9425	0.6917	0.9425	0.9708
No log	2.0465	176	0.8666	0.6617	0.8666	0.9309
No log	2.0698	178	1.1053	0.6174	1.1053	1.0513
No log	2.0930	180	1.8578	0.4046	1.8578	1.3630
No log	2.1163	182	2.4146	0.3505	2.4146	1.5539
No log	2.1395	184	2.4138	0.3627	2.4138	1.5536
No log	2.1628	186	2.0155	0.4084	2.0155	1.4197
No log	2.1860	188	1.2752	0.6087	1.2752	1.1292
No log	2.2093	190	0.8328	0.6849	0.8328	0.9126
No log	2.2326	192	0.7424	0.7483	0.7424	0.8616
No log	2.2558	194	0.7478	0.7338	0.7478	0.8648
No log	2.2791	196	0.7763	0.7153	0.7763	0.8811
No log	2.3023	198	0.8026	0.6912	0.8026	0.8959
No log	2.3256	200	0.8026	0.7153	0.8026	0.8959
No log	2.3488	202	0.8057	0.7211	0.8057	0.8976
No log	2.3721	204	0.8242	0.7403	0.8242	0.9079
No log	2.3953	206	0.8626	0.7226	0.8626	0.9287
No log	2.4186	208	1.0785	0.6474	1.0785	1.0385
No log	2.4419	210	1.3251	0.5989	1.3251	1.1511
No log	2.4651	212	1.0618	0.6816	1.0618	1.0304
No log	2.4884	214	0.8281	0.7044	0.8281	0.9100
No log	2.5116	216	0.8309	0.6757	0.8309	0.9115
No log	2.5349	218	0.8283	0.6294	0.8283	0.9101
No log	2.5581	220	0.8208	0.7179	0.8208	0.9060
No log	2.5814	222	0.8798	0.7170	0.8798	0.9380
No log	2.6047	224	0.9639	0.6709	0.9639	0.9818
No log	2.6279	226	1.0362	0.675	1.0362	1.0179
No log	2.6512	228	1.3590	0.5862	1.3590	1.1657
No log	2.6744	230	1.6539	0.5758	1.6539	1.2861
No log	2.6977	232	1.3290	0.5943	1.3290	1.1528
No log	2.7209	234	0.8723	0.6835	0.8723	0.9340
No log	2.7442	236	0.7522	0.6944	0.7522	0.8673
No log	2.7674	238	0.8576	0.6620	0.8576	0.9261
No log	2.7907	240	0.8472	0.6154	0.8472	0.9204
No log	2.8140	242	0.8371	0.6806	0.8371	0.9149
No log	2.8372	244	1.0080	0.6503	1.0080	1.0040
No log	2.8605	246	1.1269	0.6391	1.1269	1.0615
No log	2.8837	248	0.9978	0.6826	0.9978	0.9989
No log	2.9070	250	0.8483	0.6957	0.8483	0.9210
No log	2.9302	252	0.8251	0.6897	0.8251	0.9084
No log	2.9535	254	0.8333	0.6950	0.8333	0.9129
No log	2.9767	256	0.8258	0.6763	0.8258	0.9087
No log	3.0	258	0.8565	0.6377	0.8565	0.9255
No log	3.0233	260	0.8902	0.6029	0.8902	0.9435
No log	3.0465	262	0.9138	0.6667	0.9138	0.9559
No log	3.0698	264	1.0739	0.6164	1.0739	1.0363
No log	3.0930	266	1.1314	0.6087	1.1314	1.0637
No log	3.1163	268	0.9844	0.6709	0.9844	0.9922
No log	3.1395	270	0.9102	0.6928	0.9102	0.9540
No log	3.1628	272	0.9866	0.675	0.9866	0.9933
No log	3.1860	274	1.0245	0.6747	1.0245	1.0122
No log	3.2093	276	1.0520	0.6747	1.0520	1.0256
No log	3.2326	278	0.9167	0.7027	0.9167	0.9574
No log	3.2558	280	0.8922	0.6619	0.8922	0.9445
No log	3.2791	282	0.9240	0.6107	0.9240	0.9612
No log	3.3023	284	0.9567	0.5312	0.9567	0.9781
No log	3.3256	286	0.9239	0.5970	0.9239	0.9612
No log	3.3488	288	0.8801	0.6714	0.8801	0.9381
No log	3.3721	290	0.8874	0.6809	0.8874	0.9420
No log	3.3953	292	0.8927	0.6667	0.8927	0.9448
No log	3.4186	294	0.8621	0.6901	0.8621	0.9285
No log	3.4419	296	0.9307	0.6667	0.9307	0.9647
No log	3.4651	298	1.0811	0.6503	1.0811	1.0398
No log	3.4884	300	1.0646	0.65	1.0646	1.0318
No log	3.5116	302	0.8723	0.6667	0.8723	0.9340
No log	3.5349	304	0.7214	0.7133	0.7214	0.8494
No log	3.5581	306	0.7913	0.7111	0.7913	0.8895
No log	3.5814	308	0.8623	0.6853	0.8623	0.9286
No log	3.6047	310	0.8069	0.7007	0.8069	0.8983
No log	3.6279	312	0.7124	0.7172	0.7124	0.8440
No log	3.6512	314	0.7585	0.7211	0.7585	0.8709
No log	3.6744	316	0.7991	0.6897	0.7991	0.8939
No log	3.6977	318	0.7964	0.7237	0.7964	0.8924
No log	3.7209	320	0.9377	0.6625	0.9377	0.9683
No log	3.7442	322	1.1923	0.6480	1.1923	1.0919
No log	3.7674	324	1.0681	0.6441	1.0681	1.0335
No log	3.7907	326	0.9286	0.6550	0.9286	0.9636
No log	3.8140	328	0.7785	0.7561	0.7785	0.8823
No log	3.8372	330	0.7335	0.7692	0.7335	0.8565
No log	3.8605	332	0.7269	0.7651	0.7269	0.8526
No log	3.8837	334	0.7178	0.7397	0.7178	0.8472
No log	3.9070	336	0.7196	0.7483	0.7196	0.8483
No log	3.9302	338	0.7416	0.7211	0.7416	0.8612
No log	3.9535	340	0.7686	0.7067	0.7686	0.8767
No log	3.9767	342	0.8135	0.6757	0.8135	0.9019
No log	4.0	344	0.8775	0.6207	0.8775	0.9367
No log	4.0233	346	0.7881	0.6438	0.7881	0.8878
No log	4.0465	348	0.7001	0.7260	0.7001	0.8367
No log	4.0698	350	0.7254	0.6993	0.7254	0.8517
No log	4.0930	352	0.7121	0.6761	0.7121	0.8438
No log	4.1163	354	0.7337	0.6993	0.7337	0.8566
No log	4.1395	356	0.7935	0.7067	0.7935	0.8908
No log	4.1628	358	0.8580	0.6667	0.8580	0.9263
No log	4.1860	360	0.8372	0.6667	0.8372	0.9150
No log	4.2093	362	0.8010	0.6901	0.8010	0.8950
No log	4.2326	364	0.7832	0.6715	0.7832	0.8850
No log	4.2558	366	0.7505	0.6763	0.7505	0.8663
No log	4.2791	368	0.7165	0.7172	0.7165	0.8465
No log	4.3023	370	0.6857	0.7586	0.6857	0.8280
No log	4.3256	372	0.6857	0.7407	0.6857	0.8281
No log	4.3488	374	0.7210	0.7407	0.7210	0.8491
No log	4.3721	376	0.7750	0.7463	0.7750	0.8803
No log	4.3953	378	0.7857	0.6970	0.7857	0.8864
No log	4.4186	380	0.7652	0.7015	0.7652	0.8748
No log	4.4419	382	0.7401	0.7042	0.7401	0.8603
No log	4.4651	384	0.7808	0.6806	0.7808	0.8837
No log	4.4884	386	0.8112	0.6712	0.8112	0.9006
No log	4.5116	388	0.8211	0.6849	0.8211	0.9062
No log	4.5349	390	0.8554	0.6621	0.8554	0.9249
No log	4.5581	392	0.8250	0.6944	0.8250	0.9083
No log	4.5814	394	0.7881	0.6944	0.7881	0.8877
No log	4.6047	396	0.7305	0.7083	0.7305	0.8547
No log	4.6279	398	0.6961	0.7568	0.6961	0.8343
No log	4.6512	400	0.6840	0.7448	0.6840	0.8270
No log	4.6744	402	0.6797	0.7448	0.6797	0.8244
No log	4.6977	404	0.6937	0.7550	0.6937	0.8329
No log	4.7209	406	0.8206	0.6923	0.8206	0.9059
No log	4.7442	408	0.8546	0.6968	0.8546	0.9245
No log	4.7674	410	0.7970	0.7059	0.7970	0.8928
No log	4.7907	412	0.7194	0.7417	0.7194	0.8482
No log	4.8140	414	0.6907	0.7361	0.6907	0.8311
No log	4.8372	416	0.7383	0.7259	0.7383	0.8592
No log	4.8605	418	0.8284	0.6222	0.8284	0.9102
No log	4.8837	420	0.9424	0.6176	0.9424	0.9708
No log	4.9070	422	0.9036	0.6418	0.9036	0.9506
No log	4.9302	424	0.7984	0.7368	0.7984	0.8935
No log	4.9535	426	0.8078	0.7368	0.8078	0.8988
No log	4.9767	428	0.8253	0.6667	0.8253	0.9085
No log	5.0	430	0.8305	0.6617	0.8305	0.9113
No log	5.0233	432	0.8009	0.6866	0.8009	0.8949
No log	5.0465	434	0.7364	0.7299	0.7364	0.8581
No log	5.0698	436	0.7173	0.7755	0.7173	0.8469
No log	5.0930	438	0.7359	0.7368	0.7359	0.8579
No log	5.1163	440	0.6863	0.7613	0.6863	0.8284
No log	5.1395	442	0.6420	0.7606	0.6420	0.8013
No log	5.1628	444	0.7246	0.7015	0.7246	0.8512
No log	5.1860	446	0.7881	0.7015	0.7881	0.8877
No log	5.2093	448	0.7462	0.7153	0.7462	0.8638
No log	5.2326	450	0.7055	0.7194	0.7055	0.8399
No log	5.2558	452	0.7298	0.7133	0.7298	0.8543
No log	5.2791	454	0.7368	0.7105	0.7368	0.8584
No log	5.3023	456	0.7079	0.7368	0.7079	0.8414
No log	5.3256	458	0.6908	0.7368	0.6908	0.8312
No log	5.3488	460	0.6899	0.7368	0.6899	0.8306
No log	5.3721	462	0.7008	0.7273	0.7008	0.8371
No log	5.3953	464	0.7161	0.7044	0.7161	0.8462
No log	5.4186	466	0.7000	0.7375	0.7000	0.8366
No log	5.4419	468	0.6710	0.7403	0.6710	0.8191
No log	5.4651	470	0.7018	0.7429	0.7018	0.8378
No log	5.4884	472	0.7721	0.7338	0.7721	0.8787
No log	5.5116	474	0.8030	0.7206	0.8030	0.8961
No log	5.5349	476	0.7449	0.7391	0.7449	0.8631
No log	5.5581	478	0.7304	0.7606	0.7304	0.8546
No log	5.5814	480	0.8041	0.6755	0.8041	0.8967
No log	5.6047	482	0.9092	0.6174	0.9092	0.9535
No log	5.6279	484	0.8576	0.6490	0.8576	0.9261
No log	5.6512	486	0.7361	0.6928	0.7361	0.8579
No log	5.6744	488	0.6716	0.7226	0.6716	0.8195
No log	5.6977	490	0.7269	0.7308	0.7269	0.8526
No log	5.7209	492	0.7593	0.7237	0.7593	0.8714
No log	5.7442	494	0.7511	0.7105	0.7511	0.8666
No log	5.7674	496	0.7412	0.7237	0.7412	0.8609
No log	5.7907	498	0.7317	0.7114	0.7317	0.8554
0.4413	5.8140	500	0.7075	0.7067	0.7075	0.8411
0.4413	5.8372	502	0.7034	0.7067	0.7034	0.8387
0.4413	5.8605	504	0.6990	0.7143	0.6990	0.8360
0.4413	5.8837	506	0.7014	0.7067	0.7014	0.8375
0.4413	5.9070	508	0.7024	0.7211	0.7024	0.8381
0.4413	5.9302	510	0.6922	0.7083	0.6922	0.8320
0.4413	5.9535	512	0.6753	0.6993	0.6753	0.8218
0.4413	5.9767	514	0.6621	0.7465	0.6621	0.8137
0.4413	6.0	516	0.6595	0.75	0.6595	0.8121
0.4413	6.0233	518	0.6938	0.7465	0.6938	0.8329
0.4413	6.0465	520	0.7142	0.7518	0.7142	0.8451
0.4413	6.0698	522	0.7347	0.7007	0.7347	0.8572
0.4413	6.0930	524	0.7530	0.6950	0.7530	0.8677
0.4413	6.1163	526	0.8493	0.6712	0.8493	0.9216
0.4413	6.1395	528	0.8743	0.6623	0.8743	0.9350
0.4413	6.1628	530	0.9327	0.6267	0.9327	0.9658

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1