ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k1_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6835
• Qwk: 0.4831
• Mse: 0.6835
• Rmse: 0.8268

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2857	2	4.2080	-0.0097	4.2080	2.0514
No log	0.5714	4	2.5750	0.0676	2.5750	1.6047
No log	0.8571	6	1.3785	0.0205	1.3785	1.1741
No log	1.1429	8	1.0092	-0.0296	1.0092	1.0046
No log	1.4286	10	0.8890	0.0437	0.8890	0.9429
No log	1.7143	12	0.8602	0.1041	0.8602	0.9275
No log	2.0	14	0.8048	0.1808	0.8048	0.8971
No log	2.2857	16	0.8021	0.2487	0.8021	0.8956
No log	2.5714	18	0.7593	0.2010	0.7593	0.8714
No log	2.8571	20	0.7791	0.2268	0.7791	0.8826
No log	3.1429	22	0.8963	0.2233	0.8963	0.9468
No log	3.4286	24	0.9090	0.1949	0.9090	0.9534
No log	3.7143	26	0.8326	0.2419	0.8326	0.9125
No log	4.0	28	1.0161	0.1126	1.0161	1.0080
No log	4.2857	30	1.2684	0.0154	1.2684	1.1262
No log	4.5714	32	0.9670	0.1139	0.9670	0.9834
No log	4.8571	34	0.7066	0.2619	0.7066	0.8406
No log	5.1429	36	0.7151	0.2778	0.7151	0.8457
No log	5.4286	38	0.7119	0.2816	0.7119	0.8438
No log	5.7143	40	0.7082	0.2740	0.7082	0.8416
No log	6.0	42	0.7531	0.2993	0.7531	0.8678
No log	6.2857	44	0.7774	0.3550	0.7774	0.8817
No log	6.5714	46	0.8108	0.3291	0.8108	0.9004
No log	6.8571	48	0.7243	0.3865	0.7243	0.8511
No log	7.1429	50	0.7660	0.3736	0.7660	0.8752
No log	7.4286	52	0.9140	0.2665	0.9140	0.9560
No log	7.7143	54	0.8681	0.2983	0.8681	0.9317
No log	8.0	56	0.7903	0.4344	0.7903	0.8890
No log	8.2857	58	0.8429	0.4906	0.8429	0.9181
No log	8.5714	60	0.8276	0.4787	0.8276	0.9097
No log	8.8571	62	0.8046	0.3839	0.8046	0.8970
No log	9.1429	64	0.9465	0.3340	0.9465	0.9729
No log	9.4286	66	0.8568	0.3892	0.8568	0.9256
No log	9.7143	68	0.8062	0.4596	0.8062	0.8979
No log	10.0	70	0.7934	0.4771	0.7934	0.8907
No log	10.2857	72	0.7538	0.4577	0.7538	0.8682
No log	10.5714	74	0.7757	0.4601	0.7757	0.8807
No log	10.8571	76	0.9280	0.4178	0.9280	0.9633
No log	11.1429	78	0.9243	0.4371	0.9243	0.9614
No log	11.4286	80	0.7732	0.4354	0.7732	0.8793
No log	11.7143	82	0.8200	0.4861	0.8200	0.9055
No log	12.0	84	0.8359	0.4631	0.8359	0.9143
No log	12.2857	86	0.8300	0.4632	0.8300	0.9110
No log	12.5714	88	0.8146	0.4667	0.8146	0.9026
No log	12.8571	90	0.8261	0.4868	0.8261	0.9089
No log	13.1429	92	0.7883	0.4595	0.7883	0.8878
No log	13.4286	94	0.7296	0.4716	0.7296	0.8542
No log	13.7143	96	0.6941	0.4692	0.6941	0.8332
No log	14.0	98	0.6559	0.4513	0.6559	0.8099
No log	14.2857	100	0.6626	0.4894	0.6626	0.8140
No log	14.5714	102	0.7028	0.5150	0.7028	0.8384
No log	14.8571	104	0.6806	0.4986	0.6806	0.8250
No log	15.1429	106	0.7302	0.4687	0.7302	0.8545
No log	15.4286	108	0.7986	0.4493	0.7986	0.8937
No log	15.7143	110	0.8501	0.4605	0.8501	0.9220
No log	16.0	112	1.0550	0.3975	1.0550	1.0271
No log	16.2857	114	1.0780	0.3980	1.0780	1.0383
No log	16.5714	116	0.8701	0.4961	0.8701	0.9328
No log	16.8571	118	0.7715	0.4704	0.7715	0.8784
No log	17.1429	120	0.8731	0.4900	0.8731	0.9344
No log	17.4286	122	0.8813	0.4666	0.8813	0.9388
No log	17.7143	124	0.8062	0.4411	0.8062	0.8979
No log	18.0	126	0.8278	0.4373	0.8278	0.9098
No log	18.2857	128	0.7400	0.4601	0.7400	0.8603
No log	18.5714	130	0.7241	0.5448	0.7241	0.8509
No log	18.8571	132	0.8396	0.4861	0.8396	0.9163
No log	19.1429	134	0.9778	0.4248	0.9778	0.9889
No log	19.4286	136	1.0791	0.4761	1.0791	1.0388
No log	19.7143	138	0.9714	0.4938	0.9714	0.9856
No log	20.0	140	0.8077	0.5144	0.8077	0.8987
No log	20.2857	142	0.9158	0.4599	0.9158	0.9570
No log	20.5714	144	0.9439	0.4262	0.9439	0.9716
No log	20.8571	146	0.7900	0.4854	0.7900	0.8888
No log	21.1429	148	0.6943	0.4752	0.6943	0.8333
No log	21.4286	150	0.8070	0.4919	0.8070	0.8984
No log	21.7143	152	0.8621	0.4350	0.8621	0.9285
No log	22.0	154	0.8333	0.4494	0.8333	0.9129
No log	22.2857	156	0.7710	0.4514	0.7710	0.8781
No log	22.5714	158	0.7403	0.5169	0.7403	0.8604
No log	22.8571	160	0.7566	0.4350	0.7566	0.8698
No log	23.1429	162	0.7701	0.4504	0.7701	0.8775
No log	23.4286	164	0.7444	0.4881	0.7444	0.8628
No log	23.7143	166	0.8189	0.4539	0.8189	0.9049
No log	24.0	168	0.8636	0.4738	0.8636	0.9293
No log	24.2857	170	0.8588	0.4469	0.8588	0.9267
No log	24.5714	172	0.7818	0.4961	0.7818	0.8842
No log	24.8571	174	0.7471	0.5073	0.7471	0.8643
No log	25.1429	176	0.7455	0.4504	0.7455	0.8634
No log	25.4286	178	0.7154	0.5227	0.7154	0.8458
No log	25.7143	180	0.6897	0.4863	0.6897	0.8305
No log	26.0	182	0.7553	0.4756	0.7553	0.8691
No log	26.2857	184	0.8408	0.4713	0.8408	0.9169
No log	26.5714	186	0.8011	0.4616	0.8011	0.8951
No log	26.8571	188	0.7687	0.5126	0.7687	0.8768
No log	27.1429	190	0.7985	0.4281	0.7985	0.8936
No log	27.4286	192	0.7717	0.4598	0.7717	0.8784
No log	27.7143	194	0.7213	0.5064	0.7213	0.8493
No log	28.0	196	0.7332	0.4249	0.7332	0.8563
No log	28.2857	198	0.7562	0.4331	0.7562	0.8696
No log	28.5714	200	0.7362	0.4396	0.7362	0.8580
No log	28.8571	202	0.6838	0.5112	0.6838	0.8270
No log	29.1429	204	0.6355	0.5091	0.6355	0.7972
No log	29.4286	206	0.6150	0.5170	0.6150	0.7842
No log	29.7143	208	0.6307	0.4662	0.6307	0.7942
No log	30.0	210	0.6865	0.5091	0.6865	0.8286
No log	30.2857	212	0.7356	0.5203	0.7356	0.8577
No log	30.5714	214	0.7754	0.5005	0.7754	0.8806
No log	30.8571	216	0.7812	0.4977	0.7812	0.8838
No log	31.1429	218	0.7480	0.4448	0.7480	0.8649
No log	31.4286	220	0.7321	0.4474	0.7321	0.8556
No log	31.7143	222	0.7824	0.3943	0.7824	0.8846
No log	32.0	224	0.8375	0.4336	0.8375	0.9151
No log	32.2857	226	0.8545	0.4425	0.8545	0.9244
No log	32.5714	228	0.8309	0.4511	0.8309	0.9115
No log	32.8571	230	0.8241	0.4887	0.8241	0.9078
No log	33.1429	232	0.7832	0.4999	0.7832	0.8850
No log	33.4286	234	0.7477	0.4796	0.7477	0.8647
No log	33.7143	236	0.7375	0.4573	0.7375	0.8588
No log	34.0	238	0.7744	0.4733	0.7744	0.8800
No log	34.2857	240	0.7839	0.4620	0.7839	0.8854
No log	34.5714	242	0.7438	0.4383	0.7438	0.8624
No log	34.8571	244	0.7220	0.4544	0.7220	0.8497
No log	35.1429	246	0.7119	0.4598	0.7119	0.8438
No log	35.4286	248	0.7093	0.4428	0.7093	0.8422
No log	35.7143	250	0.7224	0.3889	0.7224	0.8499
No log	36.0	252	0.7157	0.4140	0.7157	0.8460
No log	36.2857	254	0.7301	0.4057	0.7301	0.8545
No log	36.5714	256	0.7567	0.4442	0.7567	0.8699
No log	36.8571	258	0.7753	0.4815	0.7753	0.8805
No log	37.1429	260	0.8264	0.4712	0.8264	0.9091
No log	37.4286	262	0.8278	0.4704	0.8278	0.9098
No log	37.7143	264	0.7876	0.4783	0.7876	0.8875
No log	38.0	266	0.7532	0.4845	0.7532	0.8679
No log	38.2857	268	0.7292	0.4731	0.7292	0.8539
No log	38.5714	270	0.7480	0.4416	0.7480	0.8648
No log	38.8571	272	0.8454	0.4828	0.8454	0.9195
No log	39.1429	274	0.9320	0.4623	0.9320	0.9654
No log	39.4286	276	0.9083	0.4732	0.9083	0.9530
No log	39.7143	278	0.7982	0.4960	0.7982	0.8934
No log	40.0	280	0.7105	0.4954	0.7105	0.8429
No log	40.2857	282	0.6885	0.5280	0.6885	0.8298
No log	40.5714	284	0.6951	0.5280	0.6951	0.8338
No log	40.8571	286	0.7124	0.4874	0.7124	0.8440
No log	41.1429	288	0.7687	0.4903	0.7687	0.8768
No log	41.4286	290	0.8269	0.4649	0.8269	0.9094
No log	41.7143	292	0.8022	0.4770	0.8022	0.8957
No log	42.0	294	0.7342	0.4812	0.7342	0.8569
No log	42.2857	296	0.6992	0.4518	0.6992	0.8362
No log	42.5714	298	0.7258	0.5119	0.7258	0.8519
No log	42.8571	300	0.7457	0.5009	0.7457	0.8635
No log	43.1429	302	0.7330	0.4897	0.7330	0.8562
No log	43.4286	304	0.7431	0.4719	0.7431	0.8620
No log	43.7143	306	0.7618	0.4764	0.7618	0.8728
No log	44.0	308	0.7667	0.4596	0.7667	0.8756
No log	44.2857	310	0.7413	0.4689	0.7413	0.8610
No log	44.5714	312	0.7356	0.4737	0.7356	0.8577
No log	44.8571	314	0.7264	0.4728	0.7264	0.8523
No log	45.1429	316	0.7172	0.4614	0.7172	0.8469
No log	45.4286	318	0.7042	0.4992	0.7042	0.8392
No log	45.7143	320	0.7041	0.5213	0.7041	0.8391
No log	46.0	322	0.7164	0.4928	0.7164	0.8464
No log	46.2857	324	0.7442	0.4682	0.7442	0.8627
No log	46.5714	326	0.7734	0.4955	0.7734	0.8794
No log	46.8571	328	0.7726	0.4813	0.7726	0.8790
No log	47.1429	330	0.7419	0.4993	0.7419	0.8614
No log	47.4286	332	0.6996	0.4545	0.6996	0.8364
No log	47.7143	334	0.6922	0.4492	0.6922	0.8320
No log	48.0	336	0.6832	0.4572	0.6832	0.8266
No log	48.2857	338	0.6930	0.4546	0.6930	0.8325
No log	48.5714	340	0.6992	0.4433	0.6992	0.8362
No log	48.8571	342	0.6917	0.4439	0.6917	0.8317
No log	49.1429	344	0.6678	0.4653	0.6678	0.8172
No log	49.4286	346	0.6540	0.5030	0.6540	0.8087
No log	49.7143	348	0.6722	0.4797	0.6722	0.8199
No log	50.0	350	0.6838	0.4534	0.6838	0.8269
No log	50.2857	352	0.6751	0.4558	0.6751	0.8217
No log	50.5714	354	0.6740	0.4529	0.6740	0.8210
No log	50.8571	356	0.6672	0.4762	0.6672	0.8169
No log	51.1429	358	0.6730	0.4848	0.6730	0.8204
No log	51.4286	360	0.6936	0.4816	0.6936	0.8328
No log	51.7143	362	0.7037	0.4773	0.7037	0.8389
No log	52.0	364	0.6870	0.4878	0.6870	0.8288
No log	52.2857	366	0.6840	0.4851	0.6840	0.8271
No log	52.5714	368	0.6703	0.4993	0.6703	0.8187
No log	52.8571	370	0.6831	0.4802	0.6831	0.8265
No log	53.1429	372	0.6867	0.4645	0.6867	0.8287
No log	53.4286	374	0.6912	0.4724	0.6912	0.8314
No log	53.7143	376	0.7012	0.4851	0.7012	0.8374
No log	54.0	378	0.7194	0.4827	0.7194	0.8482
No log	54.2857	380	0.7379	0.4850	0.7379	0.8590
No log	54.5714	382	0.7313	0.5142	0.7313	0.8552
No log	54.8571	384	0.7146	0.5100	0.7146	0.8454
No log	55.1429	386	0.6979	0.5022	0.6979	0.8354
No log	55.4286	388	0.6802	0.5073	0.6802	0.8247
No log	55.7143	390	0.6992	0.4904	0.6992	0.8362
No log	56.0	392	0.7216	0.4816	0.7216	0.8495
No log	56.2857	394	0.7269	0.4567	0.7269	0.8526
No log	56.5714	396	0.7014	0.4645	0.7014	0.8375
No log	56.8571	398	0.6766	0.4837	0.6766	0.8226
No log	57.1429	400	0.6529	0.5017	0.6529	0.8080
No log	57.4286	402	0.6471	0.4998	0.6471	0.8044
No log	57.7143	404	0.6491	0.5056	0.6491	0.8056
No log	58.0	406	0.6672	0.4726	0.6672	0.8168
No log	58.2857	408	0.7093	0.4539	0.7093	0.8422
No log	58.5714	410	0.7263	0.4506	0.7263	0.8522
No log	58.8571	412	0.7322	0.4422	0.7322	0.8557
No log	59.1429	414	0.7321	0.4422	0.7321	0.8556
No log	59.4286	416	0.7588	0.4712	0.7588	0.8711
No log	59.7143	418	0.7868	0.4420	0.7868	0.8870
No log	60.0	420	0.7638	0.4382	0.7638	0.8739
No log	60.2857	422	0.7215	0.4556	0.7215	0.8494
No log	60.5714	424	0.6995	0.4433	0.6995	0.8364
No log	60.8571	426	0.6931	0.4987	0.6931	0.8325
No log	61.1429	428	0.7023	0.4841	0.7023	0.8380
No log	61.4286	430	0.7137	0.4907	0.7137	0.8448
No log	61.7143	432	0.7434	0.4629	0.7434	0.8622
No log	62.0	434	0.7391	0.4629	0.7391	0.8597
No log	62.2857	436	0.7223	0.4746	0.7223	0.8499
No log	62.5714	438	0.6852	0.4736	0.6852	0.8278
No log	62.8571	440	0.6756	0.4729	0.6756	0.8219
No log	63.1429	442	0.6767	0.4713	0.6767	0.8226
No log	63.4286	444	0.6719	0.4777	0.6719	0.8197
No log	63.7143	446	0.6683	0.4767	0.6683	0.8175
No log	64.0	448	0.6583	0.4843	0.6583	0.8114
No log	64.2857	450	0.6565	0.5050	0.6565	0.8103
No log	64.5714	452	0.6671	0.4646	0.6671	0.8167
No log	64.8571	454	0.7010	0.4500	0.7010	0.8373
No log	65.1429	456	0.7188	0.4296	0.7188	0.8478
No log	65.4286	458	0.7311	0.4373	0.7311	0.8550
No log	65.7143	460	0.7099	0.4654	0.7099	0.8426
No log	66.0	462	0.7012	0.4746	0.7012	0.8374
No log	66.2857	464	0.6884	0.4909	0.6884	0.8297
No log	66.5714	466	0.6919	0.4896	0.6919	0.8318
No log	66.8571	468	0.6890	0.4935	0.6890	0.8301
No log	67.1429	470	0.6738	0.4891	0.6738	0.8209
No log	67.4286	472	0.6712	0.5133	0.6712	0.8192
No log	67.7143	474	0.6835	0.4939	0.6835	0.8267
No log	68.0	476	0.7099	0.4320	0.7099	0.8425
No log	68.2857	478	0.7559	0.4240	0.7559	0.8694
No log	68.5714	480	0.7783	0.4098	0.7783	0.8822
No log	68.8571	482	0.7579	0.4098	0.7579	0.8706
No log	69.1429	484	0.7168	0.3994	0.7168	0.8467
No log	69.4286	486	0.7000	0.4535	0.7000	0.8367
No log	69.7143	488	0.6919	0.4791	0.6919	0.8318
No log	70.0	490	0.6695	0.4924	0.6695	0.8182
No log	70.2857	492	0.6643	0.4913	0.6643	0.8150
No log	70.5714	494	0.6695	0.4973	0.6695	0.8183
No log	70.8571	496	0.6821	0.5041	0.6821	0.8259
No log	71.1429	498	0.6944	0.4926	0.6944	0.8333
0.26	71.4286	500	0.7177	0.4982	0.7177	0.8472
0.26	71.7143	502	0.7368	0.5132	0.7368	0.8584
0.26	72.0	504	0.7359	0.5101	0.7359	0.8578
0.26	72.2857	506	0.7420	0.4903	0.7420	0.8614
0.26	72.5714	508	0.7232	0.4873	0.7232	0.8504
0.26	72.8571	510	0.7041	0.4948	0.7041	0.8391
0.26	73.1429	512	0.6903	0.5086	0.6903	0.8309
0.26	73.4286	514	0.6882	0.5011	0.6882	0.8296
0.26	73.7143	516	0.6801	0.4999	0.6801	0.8247
0.26	74.0	518	0.6730	0.5023	0.6730	0.8204
0.26	74.2857	520	0.6736	0.5011	0.6736	0.8207
0.26	74.5714	522	0.6812	0.5106	0.6812	0.8254
0.26	74.8571	524	0.6878	0.5106	0.6878	0.8293
0.26	75.1429	526	0.6739	0.5041	0.6739	0.8209
0.26	75.4286	528	0.6579	0.5047	0.6579	0.8111
0.26	75.7143	530	0.6560	0.5071	0.6560	0.8099
0.26	76.0	532	0.6667	0.5071	0.6667	0.8165
0.26	76.2857	534	0.6700	0.5029	0.6700	0.8185
0.26	76.5714	536	0.6850	0.5135	0.6850	0.8277
0.26	76.8571	538	0.6926	0.4982	0.6926	0.8322
0.26	77.1429	540	0.6990	0.4982	0.6990	0.8360
0.26	77.4286	542	0.6964	0.4993	0.6964	0.8345
0.26	77.7143	544	0.6875	0.4912	0.6875	0.8291
0.26	78.0	546	0.6802	0.5153	0.6802	0.8248
0.26	78.2857	548	0.6787	0.4992	0.6787	0.8238
0.26	78.5714	550	0.6805	0.5245	0.6805	0.8249
0.26	78.8571	552	0.6840	0.5207	0.6840	0.8270
0.26	79.1429	554	0.6964	0.5144	0.6964	0.8345
0.26	79.4286	556	0.7108	0.4993	0.7108	0.8431
0.26	79.7143	558	0.7199	0.4993	0.7199	0.8485
0.26	80.0	560	0.7277	0.4907	0.7277	0.8530
0.26	80.2857	562	0.7224	0.4907	0.7224	0.8500
0.26	80.5714	564	0.7221	0.4758	0.7221	0.8498
0.26	80.8571	566	0.7089	0.4768	0.7089	0.8419
0.26	81.1429	568	0.6873	0.4987	0.6873	0.8290
0.26	81.4286	570	0.6633	0.4945	0.6633	0.8144
0.26	81.7143	572	0.6495	0.4999	0.6495	0.8059
0.26	82.0	574	0.6414	0.5085	0.6414	0.8009
0.26	82.2857	576	0.6458	0.5057	0.6458	0.8036
0.26	82.5714	578	0.6482	0.5057	0.6482	0.8051
0.26	82.8571	580	0.6453	0.5057	0.6453	0.8033
0.26	83.1429	582	0.6438	0.5155	0.6438	0.8024
0.26	83.4286	584	0.6505	0.5273	0.6505	0.8065
0.26	83.7143	586	0.6588	0.5101	0.6588	0.8117
0.26	84.0	588	0.6692	0.5101	0.6692	0.8181
0.26	84.2857	590	0.6840	0.5011	0.6840	0.8270
0.26	84.5714	592	0.6986	0.4807	0.6986	0.8358
0.26	84.8571	594	0.6992	0.4883	0.6992	0.8362
0.26	85.1429	596	0.6964	0.4831	0.6964	0.8345
0.26	85.4286	598	0.6928	0.4831	0.6928	0.8323
0.26	85.7143	600	0.6835	0.4831	0.6835	0.8268

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1