ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k9_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1125
• Qwk: 0.5768
• Mse: 1.1125
• Rmse: 1.0548

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0444	2	5.7080	-0.0594	5.7080	2.3892
No log	0.0889	4	3.1710	0.0497	3.1710	1.7807
No log	0.1333	6	2.6967	-0.1177	2.6967	1.6422
No log	0.1778	8	2.5595	-0.1298	2.5595	1.5998
No log	0.2222	10	1.8361	0.0198	1.8361	1.3550
No log	0.2667	12	1.5968	-0.0338	1.5968	1.2637
No log	0.3111	14	1.3164	0.1291	1.3164	1.1473
No log	0.3556	16	1.2558	0.1799	1.2558	1.1206
No log	0.4	18	1.1997	0.2365	1.1997	1.0953
No log	0.4444	20	1.1676	0.2082	1.1676	1.0806
No log	0.4889	22	1.1506	0.3058	1.1506	1.0727
No log	0.5333	24	1.1431	0.3275	1.1431	1.0692
No log	0.5778	26	1.1203	0.3252	1.1203	1.0584
No log	0.6222	28	1.1246	0.2013	1.1246	1.0605
No log	0.6667	30	1.2345	0.1360	1.2345	1.1111
No log	0.7111	32	1.3803	0.1094	1.3803	1.1749
No log	0.7556	34	1.4850	0.0792	1.4850	1.2186
No log	0.8	36	1.3925	0.1380	1.3925	1.1800
No log	0.8444	38	1.1493	0.1497	1.1493	1.0720
No log	0.8889	40	1.1140	0.1299	1.1140	1.0555
No log	0.9333	42	1.1185	0.1679	1.1185	1.0576
No log	0.9778	44	1.0840	0.2032	1.0840	1.0411
No log	1.0222	46	1.0572	0.2977	1.0572	1.0282
No log	1.0667	48	1.0672	0.3771	1.0671	1.0330
No log	1.1111	50	1.1055	0.3669	1.1055	1.0514
No log	1.1556	52	1.1558	0.3258	1.1558	1.0751
No log	1.2	54	1.0910	0.3648	1.0910	1.0445
No log	1.2444	56	1.0223	0.3190	1.0223	1.0111
No log	1.2889	58	1.0596	0.2535	1.0596	1.0294
No log	1.3333	60	1.0763	0.1843	1.0763	1.0374
No log	1.3778	62	1.0770	0.2253	1.0770	1.0378
No log	1.4222	64	1.1513	0.2737	1.1513	1.0730
No log	1.4667	66	1.1913	0.2752	1.1913	1.0915
No log	1.5111	68	1.0385	0.3324	1.0385	1.0190
No log	1.5556	70	0.9224	0.3775	0.9224	0.9604
No log	1.6	72	0.9063	0.3482	0.9063	0.9520
No log	1.6444	74	0.8895	0.3781	0.8895	0.9431
No log	1.6889	76	0.8988	0.3682	0.8988	0.9480
No log	1.7333	78	0.9275	0.3338	0.9275	0.9630
No log	1.7778	80	0.9933	0.4141	0.9933	0.9967
No log	1.8222	82	1.0508	0.4840	1.0508	1.0251
No log	1.8667	84	1.0234	0.5109	1.0234	1.0117
No log	1.9111	86	0.9499	0.4989	0.9499	0.9746
No log	1.9556	88	0.8853	0.3961	0.8853	0.9409
No log	2.0	90	0.9021	0.4283	0.9021	0.9498
No log	2.0444	92	0.9603	0.3875	0.9603	0.9800
No log	2.0889	94	0.8914	0.4534	0.8914	0.9442
No log	2.1333	96	0.9012	0.4410	0.9012	0.9493
No log	2.1778	98	1.1232	0.3651	1.1232	1.0598
No log	2.2222	100	1.2127	0.4048	1.2127	1.1012
No log	2.2667	102	1.2286	0.3995	1.2286	1.1084
No log	2.3111	104	1.1480	0.4584	1.1480	1.0715
No log	2.3556	106	0.9800	0.4881	0.9800	0.9900
No log	2.4	108	0.8855	0.5201	0.8855	0.9410
No log	2.4444	110	0.8920	0.4903	0.8920	0.9444
No log	2.4889	112	0.8974	0.4472	0.8974	0.9473
No log	2.5333	114	0.8493	0.4742	0.8493	0.9216
No log	2.5778	116	0.7958	0.5310	0.7958	0.8921
No log	2.6222	118	0.8171	0.5636	0.8171	0.9040
No log	2.6667	120	0.9027	0.5774	0.9027	0.9501
No log	2.7111	122	1.0711	0.4868	1.0711	1.0350
No log	2.7556	124	1.2302	0.3859	1.2302	1.1092
No log	2.8	126	1.3595	0.3640	1.3595	1.1660
No log	2.8444	128	1.3891	0.3640	1.3891	1.1786
No log	2.8889	130	1.3204	0.3755	1.3204	1.1491
No log	2.9333	132	1.1563	0.4437	1.1563	1.0753
No log	2.9778	134	0.9478	0.5135	0.9478	0.9735
No log	3.0222	136	0.8571	0.5004	0.8571	0.9258
No log	3.0667	138	0.8323	0.4922	0.8323	0.9123
No log	3.1111	140	0.8389	0.4866	0.8389	0.9159
No log	3.1556	142	0.8700	0.5725	0.8700	0.9327
No log	3.2	144	0.9401	0.5035	0.9401	0.9696
No log	3.2444	146	1.0058	0.4928	1.0058	1.0029
No log	3.2889	148	1.0515	0.5185	1.0515	1.0254
No log	3.3333	150	1.0657	0.5285	1.0657	1.0323
No log	3.3778	152	1.1072	0.4804	1.1072	1.0523
No log	3.4222	154	1.2094	0.4323	1.2094	1.0997
No log	3.4667	156	1.2260	0.4722	1.2260	1.1072
No log	3.5111	158	1.2256	0.3962	1.2256	1.1071
No log	3.5556	160	1.2192	0.4030	1.2192	1.1042
No log	3.6	162	1.1314	0.4553	1.1314	1.0637
No log	3.6444	164	0.9596	0.5651	0.9596	0.9796
No log	3.6889	166	0.8276	0.5874	0.8276	0.9097
No log	3.7333	168	0.7198	0.6442	0.7198	0.8484
No log	3.7778	170	0.7008	0.5778	0.7008	0.8371
No log	3.8222	172	0.6793	0.6478	0.6793	0.8242
No log	3.8667	174	0.6904	0.6608	0.6904	0.8309
No log	3.9111	176	0.7901	0.6182	0.7901	0.8889
No log	3.9556	178	0.9148	0.5770	0.9148	0.9565
No log	4.0	180	1.0345	0.5339	1.0345	1.0171
No log	4.0444	182	1.0016	0.5573	1.0016	1.0008
No log	4.0889	184	0.8575	0.5867	0.8575	0.9260
No log	4.1333	186	0.7475	0.6705	0.7475	0.8646
No log	4.1778	188	0.7191	0.6693	0.7191	0.8480
No log	4.2222	190	0.6905	0.6514	0.6905	0.8310
No log	4.2667	192	0.6861	0.6463	0.6861	0.8283
No log	4.3111	194	0.6915	0.6098	0.6915	0.8315
No log	4.3556	196	0.7663	0.6328	0.7663	0.8754
No log	4.4	198	1.0358	0.5733	1.0358	1.0177
No log	4.4444	200	1.3529	0.4240	1.3529	1.1631
No log	4.4889	202	1.5737	0.3553	1.5737	1.2545
No log	4.5333	204	1.5336	0.3533	1.5336	1.2384
No log	4.5778	206	1.2766	0.4448	1.2766	1.1299
No log	4.6222	208	1.0349	0.5082	1.0349	1.0173
No log	4.6667	210	0.9007	0.6331	0.9007	0.9491
No log	4.7111	212	0.8017	0.6242	0.8017	0.8954
No log	4.7556	214	0.7750	0.6339	0.7750	0.8803
No log	4.8	216	0.8381	0.6198	0.8381	0.9155
No log	4.8444	218	0.9322	0.5656	0.9322	0.9655
No log	4.8889	220	0.9624	0.5695	0.9624	0.9810
No log	4.9333	222	0.9767	0.5719	0.9767	0.9883
No log	4.9778	224	0.9604	0.5638	0.9604	0.9800
No log	5.0222	226	0.9242	0.5813	0.9242	0.9614
No log	5.0667	228	0.8743	0.5636	0.8743	0.9350
No log	5.1111	230	0.8436	0.6036	0.8436	0.9185
No log	5.1556	232	0.8708	0.5795	0.8708	0.9332
No log	5.2	234	0.8344	0.6241	0.8344	0.9134
No log	5.2444	236	0.8381	0.6241	0.8381	0.9155
No log	5.2889	238	0.8249	0.6366	0.8249	0.9083
No log	5.3333	240	0.8492	0.6070	0.8492	0.9215
No log	5.3778	242	1.0201	0.5271	1.0201	1.0100
No log	5.4222	244	1.1092	0.5347	1.1092	1.0532
No log	5.4667	246	1.0682	0.5444	1.0682	1.0335
No log	5.5111	248	1.0706	0.5577	1.0706	1.0347
No log	5.5556	250	1.2000	0.4887	1.2000	1.0954
No log	5.6	252	1.3056	0.4660	1.3056	1.1426
No log	5.6444	254	1.4861	0.3934	1.4861	1.2190
No log	5.6889	256	1.4819	0.4015	1.4819	1.2173
No log	5.7333	258	1.3358	0.4674	1.3358	1.1558
No log	5.7778	260	1.2300	0.5099	1.2300	1.1090
No log	5.8222	262	1.0571	0.5328	1.0571	1.0281
No log	5.8667	264	1.0024	0.5696	1.0024	1.0012
No log	5.9111	266	1.0424	0.5340	1.0424	1.0210
No log	5.9556	268	1.1165	0.5223	1.1165	1.0567
No log	6.0	270	1.0501	0.5494	1.0501	1.0247
No log	6.0444	272	0.9118	0.6055	0.9118	0.9549
No log	6.0889	274	0.8420	0.6409	0.8420	0.9176
No log	6.1333	276	0.8146	0.6405	0.8146	0.9025
No log	6.1778	278	0.8134	0.6405	0.8134	0.9019
No log	6.2222	280	0.8193	0.6509	0.8193	0.9052
No log	6.2667	282	0.9134	0.6087	0.9134	0.9557
No log	6.3111	284	0.8589	0.6324	0.8589	0.9268
No log	6.3556	286	0.7295	0.6584	0.7295	0.8541
No log	6.4	288	0.7055	0.6542	0.7055	0.8399
No log	6.4444	290	0.8199	0.6387	0.8199	0.9055
No log	6.4889	292	0.9595	0.5990	0.9595	0.9795
No log	6.5333	294	1.1004	0.5698	1.1004	1.0490
No log	6.5778	296	1.0956	0.5465	1.0956	1.0467
No log	6.6222	298	1.0747	0.5588	1.0747	1.0367
No log	6.6667	300	1.0891	0.5423	1.0891	1.0436
No log	6.7111	302	1.0695	0.5658	1.0695	1.0342
No log	6.7556	304	0.9810	0.5953	0.9810	0.9905
No log	6.8	306	0.9236	0.6114	0.9236	0.9611
No log	6.8444	308	0.9371	0.5977	0.9371	0.9680
No log	6.8889	310	0.9613	0.6037	0.9613	0.9804
No log	6.9333	312	0.9502	0.6203	0.9502	0.9748
No log	6.9778	314	0.9491	0.6226	0.9491	0.9742
No log	7.0222	316	0.9558	0.6122	0.9558	0.9777
No log	7.0667	318	0.9668	0.6068	0.9668	0.9832
No log	7.1111	320	0.9733	0.5880	0.9733	0.9865
No log	7.1556	322	0.9425	0.6006	0.9425	0.9708
No log	7.2	324	0.9359	0.5921	0.9359	0.9674
No log	7.2444	326	0.9817	0.5793	0.9817	0.9908
No log	7.2889	328	1.0672	0.5659	1.0672	1.0331
No log	7.3333	330	1.0739	0.5648	1.0739	1.0363
No log	7.3778	332	1.0767	0.5253	1.0767	1.0376
No log	7.4222	334	0.9799	0.5619	0.9799	0.9899
No log	7.4667	336	0.8830	0.6045	0.8830	0.9397
No log	7.5111	338	0.8805	0.6172	0.8805	0.9384
No log	7.5556	340	0.8540	0.6116	0.8540	0.9241
No log	7.6	342	0.9240	0.5640	0.9240	0.9612
No log	7.6444	344	0.9387	0.5613	0.9387	0.9689
No log	7.6889	346	1.0225	0.5477	1.0225	1.0112
No log	7.7333	348	1.0942	0.5456	1.0942	1.0460
No log	7.7778	350	0.9537	0.5917	0.9537	0.9766
No log	7.8222	352	0.7947	0.6505	0.7947	0.8915
No log	7.8667	354	0.7308	0.6458	0.7308	0.8549
No log	7.9111	356	0.6955	0.6390	0.6955	0.8340
No log	7.9556	358	0.6626	0.6705	0.6626	0.8140
No log	8.0	360	0.6982	0.6843	0.6982	0.8356
No log	8.0444	362	0.7746	0.7008	0.7746	0.8801
No log	8.0889	364	0.8669	0.6431	0.8669	0.9311
No log	8.1333	366	0.8361	0.6395	0.8361	0.9144
No log	8.1778	368	0.8252	0.6422	0.8252	0.9084
No log	8.2222	370	0.8488	0.6162	0.8488	0.9213
No log	8.2667	372	0.8420	0.5887	0.8420	0.9176
No log	8.3111	374	0.8901	0.5823	0.8901	0.9435
No log	8.3556	376	0.9102	0.5838	0.9102	0.9540
No log	8.4	378	0.9567	0.5611	0.9567	0.9781
No log	8.4444	380	1.0026	0.5719	1.0026	1.0013
No log	8.4889	382	0.9422	0.5579	0.9422	0.9707
No log	8.5333	384	0.9013	0.6019	0.9013	0.9494
No log	8.5778	386	0.9489	0.6034	0.9489	0.9741
No log	8.6222	388	0.9412	0.5938	0.9412	0.9702
No log	8.6667	390	0.9777	0.5681	0.9777	0.9888
No log	8.7111	392	1.0687	0.5612	1.0687	1.0338
No log	8.7556	394	1.0373	0.5931	1.0373	1.0185
No log	8.8	396	0.9860	0.6041	0.9860	0.9930
No log	8.8444	398	0.9013	0.6210	0.9013	0.9494
No log	8.8889	400	0.8139	0.6233	0.8139	0.9022
No log	8.9333	402	0.8289	0.6198	0.8289	0.9104
No log	8.9778	404	0.9538	0.5744	0.9538	0.9766
No log	9.0222	406	1.1603	0.4917	1.1603	1.0772
No log	9.0667	408	1.2586	0.5139	1.2586	1.1219
No log	9.1111	410	1.1757	0.5418	1.1757	1.0843
No log	9.1556	412	1.1048	0.5721	1.1048	1.0511
No log	9.2	414	0.9969	0.5597	0.9969	0.9985
No log	9.2444	416	0.9049	0.5832	0.9049	0.9513
No log	9.2889	418	0.8314	0.6223	0.8314	0.9118
No log	9.3333	420	0.8358	0.6274	0.8358	0.9142
No log	9.3778	422	0.9395	0.5780	0.9395	0.9693
No log	9.4222	424	1.0914	0.5815	1.0914	1.0447
No log	9.4667	426	1.1131	0.5663	1.1131	1.0551
No log	9.5111	428	0.9692	0.5882	0.9692	0.9845
No log	9.5556	430	0.8273	0.6339	0.8273	0.9096
No log	9.6	432	0.8055	0.6309	0.8055	0.8975
No log	9.6444	434	0.8626	0.5990	0.8626	0.9288
No log	9.6889	436	0.9633	0.5281	0.9633	0.9815
No log	9.7333	438	1.0492	0.5214	1.0492	1.0243
No log	9.7778	440	1.0829	0.5101	1.0829	1.0406
No log	9.8222	442	1.0852	0.5087	1.0852	1.0417
No log	9.8667	444	1.0519	0.5153	1.0519	1.0256
No log	9.9111	446	0.9749	0.5270	0.9749	0.9874
No log	9.9556	448	0.9049	0.5744	0.9049	0.9513
No log	10.0	450	0.8153	0.6339	0.8153	0.9029
No log	10.0444	452	0.7613	0.6739	0.7613	0.8726
No log	10.0889	454	0.8286	0.6418	0.8286	0.9103
No log	10.1333	456	1.0021	0.5440	1.0021	1.0011
No log	10.1778	458	1.1885	0.5175	1.1885	1.0902
No log	10.2222	460	1.3658	0.5050	1.3658	1.1687
No log	10.2667	462	1.3426	0.5103	1.3426	1.1587
No log	10.3111	464	1.1378	0.4972	1.1378	1.0667
No log	10.3556	466	1.0435	0.5449	1.0435	1.0215
No log	10.4	468	1.0002	0.5508	1.0002	1.0001
No log	10.4444	470	1.0325	0.5429	1.0325	1.0161
No log	10.4889	472	1.1153	0.5240	1.1153	1.0561
No log	10.5333	474	1.2203	0.5096	1.2203	1.1047
No log	10.5778	476	1.1575	0.5293	1.1575	1.0759
No log	10.6222	478	0.9378	0.5967	0.9378	0.9684
No log	10.6667	480	0.7887	0.6274	0.7887	0.8881
No log	10.7111	482	0.7289	0.6520	0.7289	0.8538
No log	10.7556	484	0.7117	0.6475	0.7117	0.8436
No log	10.8	486	0.7997	0.6285	0.7997	0.8943
No log	10.8444	488	0.9872	0.5963	0.9872	0.9936
No log	10.8889	490	1.1844	0.5336	1.1844	1.0883
No log	10.9333	492	1.1716	0.4961	1.1716	1.0824
No log	10.9778	494	1.1702	0.5030	1.1702	1.0818
No log	11.0222	496	1.0779	0.5483	1.0779	1.0382
No log	11.0667	498	0.9484	0.5692	0.9484	0.9739
0.4691	11.1111	500	0.8988	0.5989	0.8988	0.9481
0.4691	11.1556	502	0.9705	0.5638	0.9705	0.9851
0.4691	11.2	504	1.0983	0.5341	1.0983	1.0480
0.4691	11.2444	506	1.1794	0.5281	1.1794	1.0860
0.4691	11.2889	508	1.0360	0.5398	1.0360	1.0178
0.4691	11.3333	510	0.8668	0.6157	0.8668	0.9310
0.4691	11.3778	512	0.8766	0.5922	0.8766	0.9363
0.4691	11.4222	514	0.9738	0.5969	0.9738	0.9868
0.4691	11.4667	516	1.1259	0.5675	1.1259	1.0611
0.4691	11.5111	518	1.1778	0.5698	1.1778	1.0853
0.4691	11.5556	520	1.1125	0.5768	1.1125	1.0548

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1