ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k5_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5741
• Qwk: 0.6476
• Mse: 0.5741
• Rmse: 0.7577

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0714	2	4.2665	-0.0008	4.2665	2.0655
No log	0.1429	4	2.2553	0.0372	2.2553	1.5018
No log	0.2143	6	1.3937	0.0143	1.3937	1.1805
No log	0.2857	8	1.1633	0.2074	1.1633	1.0786
No log	0.3571	10	1.1179	0.1962	1.1179	1.0573
No log	0.4286	12	1.1117	0.1046	1.1117	1.0543
No log	0.5	14	1.1202	0.0888	1.1202	1.0584
No log	0.5714	16	1.1300	0.0888	1.1300	1.0630
No log	0.6429	18	1.1067	0.1767	1.1067	1.0520
No log	0.7143	20	1.0641	0.2068	1.0641	1.0315
No log	0.7857	22	1.0307	0.4309	1.0307	1.0152
No log	0.8571	24	1.0287	0.4301	1.0287	1.0142
No log	0.9286	26	1.0043	0.4439	1.0043	1.0021
No log	1.0	28	0.9673	0.3377	0.9673	0.9835
No log	1.0714	30	1.1320	0.2017	1.1320	1.0640
No log	1.1429	32	1.0725	0.3126	1.0725	1.0356
No log	1.2143	34	0.8753	0.4626	0.8753	0.9356
No log	1.2857	36	0.8905	0.4603	0.8905	0.9437
No log	1.3571	38	0.8542	0.4850	0.8542	0.9242
No log	1.4286	40	0.8431	0.5302	0.8431	0.9182
No log	1.5	42	0.8178	0.4878	0.8178	0.9043
No log	1.5714	44	0.9157	0.4460	0.9157	0.9569
No log	1.6429	46	1.0640	0.3361	1.0640	1.0315
No log	1.7143	48	1.2892	0.2748	1.2892	1.1354
No log	1.7857	50	1.0612	0.4321	1.0612	1.0302
No log	1.8571	52	0.7983	0.5264	0.7983	0.8935
No log	1.9286	54	0.7837	0.5524	0.7837	0.8853
No log	2.0	56	0.7894	0.5571	0.7894	0.8885
No log	2.0714	58	1.2080	0.3321	1.2080	1.0991
No log	2.1429	60	1.2520	0.3393	1.2520	1.1189
No log	2.2143	62	0.8305	0.5025	0.8305	0.9113
No log	2.2857	64	0.7834	0.5311	0.7834	0.8851
No log	2.3571	66	1.3820	0.3902	1.3820	1.1756
No log	2.4286	68	1.4530	0.2591	1.4530	1.2054
No log	2.5	70	1.0656	0.3461	1.0656	1.0323
No log	2.5714	72	0.6613	0.5988	0.6613	0.8132
No log	2.6429	74	0.6193	0.6043	0.6193	0.7869
No log	2.7143	76	0.6432	0.5810	0.6432	0.8020
No log	2.7857	78	0.6676	0.5810	0.6676	0.8171
No log	2.8571	80	0.7163	0.5568	0.7163	0.8463
No log	2.9286	82	0.8010	0.4563	0.8010	0.8950
No log	3.0	84	0.6922	0.5854	0.6922	0.8320
No log	3.0714	86	0.7260	0.5156	0.7260	0.8520
No log	3.1429	88	0.8056	0.5686	0.8056	0.8975
No log	3.2143	90	0.7165	0.5064	0.7165	0.8465
No log	3.2857	92	0.6686	0.6262	0.6686	0.8177
No log	3.3571	94	0.6857	0.5882	0.6857	0.8281
No log	3.4286	96	0.7259	0.5783	0.7259	0.8520
No log	3.5	98	0.7426	0.5653	0.7426	0.8618
No log	3.5714	100	0.7457	0.4995	0.7457	0.8635
No log	3.6429	102	0.7332	0.5503	0.7332	0.8563
No log	3.7143	104	0.7731	0.4893	0.7731	0.8793
No log	3.7857	106	0.7084	0.5868	0.7084	0.8417
No log	3.8571	108	0.7162	0.5726	0.7162	0.8463
No log	3.9286	110	0.7830	0.5151	0.7830	0.8849
No log	4.0	112	0.7588	0.5971	0.7588	0.8711
No log	4.0714	114	0.6628	0.6144	0.6628	0.8142
No log	4.1429	116	0.6312	0.6365	0.6312	0.7945
No log	4.2143	118	0.6237	0.6196	0.6237	0.7897
No log	4.2857	120	0.6221	0.6435	0.6221	0.7888
No log	4.3571	122	0.6542	0.6035	0.6542	0.8088
No log	4.4286	124	0.9259	0.4988	0.9259	0.9622
No log	4.5	126	1.0447	0.4383	1.0447	1.0221
No log	4.5714	128	0.9195	0.4272	0.9195	0.9589
No log	4.6429	130	0.7320	0.5770	0.7320	0.8556
No log	4.7143	132	0.6939	0.5759	0.6939	0.8330
No log	4.7857	134	0.9291	0.4440	0.9291	0.9639
No log	4.8571	136	1.0066	0.4835	1.0066	1.0033
No log	4.9286	138	0.8117	0.5552	0.8117	0.9010
No log	5.0	140	0.6526	0.6204	0.6526	0.8079
No log	5.0714	142	0.6687	0.5917	0.6687	0.8178
No log	5.1429	144	0.8723	0.4864	0.8723	0.9340
No log	5.2143	146	1.0586	0.4924	1.0586	1.0289
No log	5.2857	148	0.9457	0.4913	0.9457	0.9725
No log	5.3571	150	0.6355	0.6175	0.6355	0.7972
No log	5.4286	152	0.5955	0.6796	0.5955	0.7717
No log	5.5	154	0.6927	0.6476	0.6927	0.8323
No log	5.5714	156	0.8530	0.5531	0.8530	0.9236
No log	5.6429	158	0.8246	0.5541	0.8246	0.9080
No log	5.7143	160	0.7056	0.6338	0.7056	0.8400
No log	5.7857	162	0.6275	0.6684	0.6275	0.7921
No log	5.8571	164	0.6109	0.6482	0.6109	0.7816
No log	5.9286	166	0.5979	0.6301	0.5979	0.7732
No log	6.0	168	0.6413	0.6090	0.6413	0.8008
No log	6.0714	170	0.7700	0.5828	0.7700	0.8775
No log	6.1429	172	0.7908	0.5384	0.7908	0.8893
No log	6.2143	174	0.6283	0.5614	0.6283	0.7926
No log	6.2857	176	0.6760	0.5540	0.6760	0.8222
No log	6.3571	178	0.7876	0.5033	0.7876	0.8874
No log	6.4286	180	0.6972	0.5707	0.6972	0.8350
No log	6.5	182	0.6119	0.6476	0.6119	0.7822
No log	6.5714	184	0.7027	0.5828	0.7027	0.8383
No log	6.6429	186	0.6975	0.5828	0.6975	0.8351
No log	6.7143	188	0.6794	0.5606	0.6794	0.8242
No log	6.7857	190	0.6358	0.5938	0.6358	0.7974
No log	6.8571	192	0.6420	0.6231	0.6420	0.8012
No log	6.9286	194	0.6349	0.6499	0.6349	0.7968
No log	7.0	196	0.6403	0.5653	0.6403	0.8002
No log	7.0714	198	0.6734	0.5857	0.6734	0.8206
No log	7.1429	200	0.6284	0.5536	0.6284	0.7927
No log	7.2143	202	0.6629	0.5811	0.6629	0.8142
No log	7.2857	204	0.8095	0.4695	0.8095	0.8997
No log	7.3571	206	0.7548	0.5416	0.7548	0.8688
No log	7.4286	208	0.6300	0.6096	0.6300	0.7937
No log	7.5	210	0.6422	0.5870	0.6422	0.8014
No log	7.5714	212	0.6350	0.6436	0.6350	0.7969
No log	7.6429	214	0.6052	0.6593	0.6052	0.7779
No log	7.7143	216	0.6051	0.6593	0.6051	0.7779
No log	7.7857	218	0.6233	0.6533	0.6233	0.7895
No log	7.8571	220	0.6972	0.5759	0.6972	0.8350
No log	7.9286	222	0.6968	0.5759	0.6968	0.8348
No log	8.0	224	0.6391	0.6194	0.6391	0.7995
No log	8.0714	226	0.6192	0.5759	0.6192	0.7869
No log	8.1429	228	0.6156	0.5759	0.6156	0.7846
No log	8.2143	230	0.5999	0.6561	0.5999	0.7745
No log	8.2857	232	0.6299	0.5837	0.6299	0.7937
No log	8.3571	234	0.8276	0.5634	0.8276	0.9097
No log	8.4286	236	0.8864	0.5541	0.8864	0.9415
No log	8.5	238	0.7328	0.6092	0.7328	0.8560
No log	8.5714	240	0.5740	0.6499	0.5740	0.7576
No log	8.6429	242	0.5654	0.6113	0.5654	0.7519
No log	8.7143	244	0.5780	0.5759	0.5780	0.7603
No log	8.7857	246	0.6068	0.4966	0.6068	0.7790
No log	8.8571	248	0.6118	0.4966	0.6118	0.7822
No log	8.9286	250	0.6055	0.4951	0.6055	0.7781
No log	9.0	252	0.6208	0.5212	0.6208	0.7879
No log	9.0714	254	0.5938	0.6107	0.5938	0.7706
No log	9.1429	256	0.6066	0.5656	0.6066	0.7789
No log	9.2143	258	0.6727	0.5573	0.6727	0.8202
No log	9.2857	260	0.6699	0.4960	0.6699	0.8185
No log	9.3571	262	0.6765	0.4960	0.6765	0.8225
No log	9.4286	264	0.6542	0.5063	0.6542	0.8088
No log	9.5	266	0.6330	0.6322	0.6330	0.7956
No log	9.5714	268	0.6382	0.5879	0.6382	0.7989
No log	9.6429	270	0.6780	0.5686	0.6780	0.8234
No log	9.7143	272	0.6336	0.6479	0.6336	0.7960
No log	9.7857	274	0.5975	0.6269	0.5975	0.7730
No log	9.8571	276	0.6092	0.6425	0.6092	0.7805
No log	9.9286	278	0.6021	0.6067	0.6021	0.7759
No log	10.0	280	0.6475	0.6164	0.6475	0.8046
No log	10.0714	282	0.6595	0.5727	0.6595	0.8121
No log	10.1429	284	0.6665	0.5629	0.6665	0.8164
No log	10.2143	286	0.6057	0.6383	0.6057	0.7782
No log	10.2857	288	0.6097	0.6065	0.6097	0.7808
No log	10.3571	290	0.6255	0.6317	0.6255	0.7909
No log	10.4286	292	0.6794	0.5581	0.6794	0.8243
No log	10.5	294	0.7850	0.4837	0.7850	0.8860
No log	10.5714	296	0.7425	0.5381	0.7425	0.8617
No log	10.6429	298	0.6336	0.6241	0.6336	0.7960
No log	10.7143	300	0.6259	0.5992	0.6259	0.7911
No log	10.7857	302	0.6087	0.5883	0.6087	0.7802
No log	10.8571	304	0.5796	0.6491	0.5796	0.7613
No log	10.9286	306	0.7106	0.6241	0.7106	0.8430
No log	11.0	308	0.8908	0.5272	0.8908	0.9438
No log	11.0714	310	0.8988	0.5090	0.8988	0.9481
No log	11.1429	312	0.7158	0.5857	0.7158	0.8461
No log	11.2143	314	0.5773	0.5980	0.5773	0.7598
No log	11.2857	316	0.6557	0.5846	0.6557	0.8097
No log	11.3571	318	0.6464	0.5992	0.6464	0.8040
No log	11.4286	320	0.5970	0.6221	0.5970	0.7727
No log	11.5	322	0.6605	0.5818	0.6605	0.8127
No log	11.5714	324	0.7303	0.5154	0.7303	0.8546
No log	11.6429	326	0.6466	0.5659	0.6466	0.8041
No log	11.7143	328	0.5522	0.6888	0.5522	0.7431
No log	11.7857	330	0.6011	0.6429	0.6011	0.7753
No log	11.8571	332	0.6402	0.6071	0.6402	0.8001
No log	11.9286	334	0.6630	0.6071	0.6630	0.8143
No log	12.0	336	0.6558	0.5954	0.6558	0.8098
No log	12.0714	338	0.6472	0.5161	0.6472	0.8045
No log	12.1429	340	0.6451	0.4941	0.6451	0.8032
No log	12.2143	342	0.6511	0.5718	0.6511	0.8069
No log	12.2857	344	0.6149	0.6248	0.6149	0.7842
No log	12.3571	346	0.5564	0.6716	0.5564	0.7459
No log	12.4286	348	0.5345	0.6846	0.5345	0.7311
No log	12.5	350	0.6174	0.6199	0.6174	0.7857
No log	12.5714	352	0.6332	0.6377	0.6332	0.7957
No log	12.6429	354	0.5679	0.6555	0.5679	0.7536
No log	12.7143	356	0.5395	0.6720	0.5395	0.7345
No log	12.7857	358	0.5565	0.6316	0.5565	0.7460
No log	12.8571	360	0.5816	0.6322	0.5816	0.7626
No log	12.9286	362	0.5959	0.6322	0.5959	0.7719
No log	13.0	364	0.5836	0.6302	0.5836	0.7639
No log	13.0714	366	0.5853	0.6118	0.5853	0.7651
No log	13.1429	368	0.5826	0.6118	0.5826	0.7633
No log	13.2143	370	0.6134	0.6129	0.6134	0.7832
No log	13.2857	372	0.6311	0.5909	0.6311	0.7944
No log	13.3571	374	0.6735	0.5372	0.6735	0.8207
No log	13.4286	376	0.6359	0.6111	0.6359	0.7974
No log	13.5	378	0.6043	0.5987	0.6043	0.7774
No log	13.5714	380	0.5498	0.6812	0.5498	0.7415
No log	13.6429	382	0.5295	0.6398	0.5295	0.7277
No log	13.7143	384	0.5344	0.6424	0.5344	0.7310
No log	13.7857	386	0.5502	0.6498	0.5502	0.7417
No log	13.8571	388	0.5656	0.6400	0.5656	0.7521
No log	13.9286	390	0.5563	0.6364	0.5563	0.7459
No log	14.0	392	0.5502	0.6681	0.5502	0.7418
No log	14.0714	394	0.5624	0.6197	0.5624	0.7500
No log	14.1429	396	0.5637	0.6488	0.5637	0.7508
No log	14.2143	398	0.5807	0.6588	0.5807	0.7620
No log	14.2857	400	0.5848	0.6017	0.5848	0.7647
No log	14.3571	402	0.5670	0.6796	0.5670	0.7530
No log	14.4286	404	0.5605	0.6407	0.5605	0.7487
No log	14.5	406	0.5511	0.6606	0.5511	0.7424
No log	14.5714	408	0.5599	0.6175	0.5599	0.7483
No log	14.6429	410	0.6032	0.6217	0.6032	0.7767
No log	14.7143	412	0.6354	0.6495	0.6354	0.7971
No log	14.7857	414	0.6114	0.6217	0.6114	0.7819
No log	14.8571	416	0.6030	0.6217	0.6030	0.7766
No log	14.9286	418	0.6059	0.6312	0.6059	0.7784
No log	15.0	420	0.6190	0.6620	0.6190	0.7868
No log	15.0714	422	0.6345	0.6620	0.6345	0.7966
No log	15.1429	424	0.6201	0.6634	0.6201	0.7875
No log	15.2143	426	0.6255	0.5983	0.6255	0.7909
No log	15.2857	428	0.6358	0.5983	0.6358	0.7974
No log	15.3571	430	0.6366	0.5983	0.6366	0.7979
No log	15.4286	432	0.6348	0.5983	0.6348	0.7967
No log	15.5	434	0.6501	0.5331	0.6501	0.8063
No log	15.5714	436	0.6482	0.6139	0.6482	0.8051
No log	15.6429	438	0.6261	0.6470	0.6261	0.7912
No log	15.7143	440	0.6394	0.6555	0.6394	0.7996
No log	15.7857	442	0.6537	0.6305	0.6537	0.8085
No log	15.8571	444	0.6602	0.6128	0.6602	0.8125
No log	15.9286	446	0.6249	0.6545	0.6249	0.7905
No log	16.0	448	0.6311	0.6204	0.6311	0.7944
No log	16.0714	450	0.6468	0.6035	0.6468	0.8042
No log	16.1429	452	0.6469	0.5936	0.6469	0.8043
No log	16.2143	454	0.6324	0.5936	0.6324	0.7952
No log	16.2857	456	0.6121	0.6444	0.6121	0.7824
No log	16.3571	458	0.6223	0.6035	0.6223	0.7889
No log	16.4286	460	0.6295	0.5912	0.6295	0.7934
No log	16.5	462	0.5971	0.6256	0.5971	0.7727
No log	16.5714	464	0.5903	0.6256	0.5903	0.7683
No log	16.6429	466	0.6188	0.6488	0.6188	0.7866
No log	16.7143	468	0.6490	0.5659	0.6490	0.8056
No log	16.7857	470	0.6406	0.6204	0.6406	0.8004
No log	16.8571	472	0.6018	0.6479	0.6018	0.7757
No log	16.9286	474	0.5797	0.6272	0.5797	0.7614
No log	17.0	476	0.5956	0.6593	0.5956	0.7717
No log	17.0714	478	0.5994	0.6555	0.5994	0.7742
No log	17.1429	480	0.6104	0.6482	0.6104	0.7813
No log	17.2143	482	0.6104	0.6370	0.6104	0.7813
No log	17.2857	484	0.5848	0.6219	0.5848	0.7647
No log	17.3571	486	0.5990	0.6507	0.5990	0.7740
No log	17.4286	488	0.6030	0.6184	0.6030	0.7765
No log	17.5	490	0.5717	0.5982	0.5717	0.7561
No log	17.5714	492	0.5485	0.7186	0.5485	0.7406
No log	17.6429	494	0.5630	0.6664	0.5630	0.7503
No log	17.7143	496	0.5565	0.6704	0.5565	0.7460
No log	17.7857	498	0.5446	0.7291	0.5446	0.7380
0.2822	17.8571	500	0.5554	0.6556	0.5554	0.7453
0.2822	17.9286	502	0.5801	0.6298	0.5801	0.7617
0.2822	18.0	504	0.5717	0.6322	0.5717	0.7561
0.2822	18.0714	506	0.5539	0.6750	0.5539	0.7443
0.2822	18.1429	508	0.5489	0.7017	0.5489	0.7409
0.2822	18.2143	510	0.5661	0.6788	0.5661	0.7524
0.2822	18.2857	512	0.5660	0.6833	0.5660	0.7523
0.2822	18.3571	514	0.5586	0.6648	0.5586	0.7474
0.2822	18.4286	516	0.5457	0.7075	0.5457	0.7387
0.2822	18.5	518	0.5421	0.7165	0.5421	0.7363
0.2822	18.5714	520	0.5708	0.6862	0.5708	0.7555
0.2822	18.6429	522	0.5475	0.6963	0.5475	0.7399
0.2822	18.7143	524	0.5257	0.7208	0.5257	0.7250
0.2822	18.7857	526	0.5263	0.7075	0.5263	0.7255
0.2822	18.8571	528	0.5294	0.7017	0.5294	0.7276
0.2822	18.9286	530	0.5461	0.7017	0.5461	0.7390
0.2822	19.0	532	0.5487	0.6958	0.5487	0.7407
0.2822	19.0714	534	0.5699	0.6401	0.5699	0.7549
0.2822	19.1429	536	0.6250	0.6058	0.6250	0.7905
0.2822	19.2143	538	0.6399	0.5623	0.6399	0.7999
0.2822	19.2857	540	0.6155	0.6172	0.6155	0.7845
0.2822	19.3571	542	0.5741	0.6476	0.5741	0.7577

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1