ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run1_AugV5_k20_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8665
• Qwk: 0.3941
• Mse: 0.8665
• Rmse: 0.9308

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0206	2	3.9551	-0.0254	3.9551	1.9888
No log	0.0412	4	2.3474	0.0074	2.3474	1.5321
No log	0.0619	6	1.5871	-0.0180	1.5871	1.2598
No log	0.0825	8	1.2246	0.1725	1.2246	1.1066
No log	0.1031	10	1.3841	0.0945	1.3841	1.1765
No log	0.1237	12	1.2036	0.2042	1.2036	1.0971
No log	0.1443	14	1.1276	0.2166	1.1276	1.0619
No log	0.1649	16	1.2398	0.1927	1.2398	1.1135
No log	0.1856	18	1.0808	0.2787	1.0808	1.0396
No log	0.2062	20	1.0886	0.2384	1.0886	1.0433
No log	0.2268	22	1.0945	0.2820	1.0945	1.0462
No log	0.2474	24	0.9971	0.1589	0.9971	0.9986
No log	0.2680	26	1.2928	0.1086	1.2928	1.1370
No log	0.2887	28	1.2753	0.0701	1.2753	1.1293
No log	0.3093	30	1.0397	0.1589	1.0397	1.0196
No log	0.3299	32	1.1580	0.3119	1.1580	1.0761
No log	0.3505	34	1.1094	0.3062	1.1094	1.0533
No log	0.3711	36	1.0093	0.2042	1.0093	1.0047
No log	0.3918	38	1.2665	0.1290	1.2665	1.1254
No log	0.4124	40	1.3629	0.1476	1.3629	1.1674
No log	0.4330	42	1.2445	0.1745	1.2445	1.1156
No log	0.4536	44	1.0497	0.1874	1.0497	1.0246
No log	0.4742	46	1.0651	0.2448	1.0651	1.0321
No log	0.4948	48	1.0867	0.1971	1.0867	1.0425
No log	0.5155	50	1.0691	0.2114	1.0691	1.0340
No log	0.5361	52	1.0778	0.1713	1.0778	1.0382
No log	0.5567	54	1.0459	0.1864	1.0459	1.0227
No log	0.5773	56	1.0333	0.1989	1.0333	1.0165
No log	0.5979	58	1.1452	0.0576	1.1452	1.0702
No log	0.6186	60	1.0140	0.0914	1.0140	1.0070
No log	0.6392	62	0.9485	0.3651	0.9485	0.9739
No log	0.6598	64	0.9357	0.4416	0.9357	0.9673
No log	0.6804	66	1.0069	0.2842	1.0069	1.0034
No log	0.7010	68	1.0947	0.3262	1.0947	1.0463
No log	0.7216	70	0.9609	0.3087	0.9609	0.9802
No log	0.7423	72	0.9348	0.4180	0.9348	0.9669
No log	0.7629	74	0.9820	0.3487	0.9820	0.9910
No log	0.7835	76	0.9346	0.5048	0.9346	0.9668
No log	0.8041	78	1.2090	0.2790	1.2090	1.0996
No log	0.8247	80	1.9224	-0.0431	1.9224	1.3865
No log	0.8454	82	2.1542	-0.3061	2.1542	1.4677
No log	0.8660	84	1.5762	-0.0274	1.5762	1.2555
No log	0.8866	86	0.9173	0.3089	0.9173	0.9578
No log	0.9072	88	0.9701	0.3793	0.9701	0.9849
No log	0.9278	90	1.0882	0.2964	1.0882	1.0432
No log	0.9485	92	0.9439	0.3066	0.9439	0.9715
No log	0.9691	94	0.8275	0.3780	0.8275	0.9097
No log	0.9897	96	1.0590	0.3283	1.0590	1.0291
No log	1.0103	98	1.1426	0.2816	1.1426	1.0689
No log	1.0309	100	1.0083	0.3354	1.0083	1.0041
No log	1.0515	102	0.8483	0.4198	0.8483	0.9211
No log	1.0722	104	0.8128	0.3425	0.8128	0.9015
No log	1.0928	106	0.8434	0.3651	0.8434	0.9183
No log	1.1134	108	0.8198	0.4544	0.8198	0.9054
No log	1.1340	110	0.8414	0.5220	0.8414	0.9173
No log	1.1546	112	1.0712	0.4016	1.0712	1.0350
No log	1.1753	114	1.2753	0.2557	1.2753	1.1293
No log	1.1959	116	1.3966	0.2329	1.3966	1.1818
No log	1.2165	118	1.1813	0.3575	1.1813	1.0869
No log	1.2371	120	0.9415	0.3929	0.9415	0.9703
No log	1.2577	122	0.8415	0.4595	0.8415	0.9173
No log	1.2784	124	0.7888	0.4626	0.7888	0.8882
No log	1.2990	126	0.7828	0.4381	0.7828	0.8847
No log	1.3196	128	0.7923	0.4520	0.7923	0.8901
No log	1.3402	130	0.8373	0.4067	0.8373	0.9150
No log	1.3608	132	0.9033	0.4546	0.9033	0.9504
No log	1.3814	134	0.8913	0.4789	0.8913	0.9441
No log	1.4021	136	0.9184	0.3945	0.9184	0.9583
No log	1.4227	138	0.9270	0.3945	0.9270	0.9628
No log	1.4433	140	1.0729	0.3286	1.0729	1.0358
No log	1.4639	142	1.1277	0.3310	1.1277	1.0619
No log	1.4845	144	1.0774	0.3256	1.0774	1.0380
No log	1.5052	146	1.0185	0.3808	1.0185	1.0092
No log	1.5258	148	1.0374	0.3771	1.0374	1.0185
No log	1.5464	150	1.0413	0.3216	1.0413	1.0204
No log	1.5670	152	0.9977	0.3635	0.9977	0.9989
No log	1.5876	154	1.0004	0.3635	1.0004	1.0002
No log	1.6082	156	1.0926	0.4158	1.0926	1.0453
No log	1.6289	158	1.0864	0.4226	1.0864	1.0423
No log	1.6495	160	1.0030	0.4255	1.0030	1.0015
No log	1.6701	162	1.0326	0.4255	1.0326	1.0162
No log	1.6907	164	1.1128	0.4141	1.1128	1.0549
No log	1.7113	166	1.0881	0.4212	1.0881	1.0431
No log	1.7320	168	0.9559	0.3691	0.9559	0.9777
No log	1.7526	170	0.9139	0.3668	0.9139	0.9560
No log	1.7732	172	0.9827	0.3826	0.9827	0.9913
No log	1.7938	174	1.0248	0.4326	1.0248	1.0123
No log	1.8144	176	1.0540	0.4130	1.0540	1.0266
No log	1.8351	178	0.9661	0.4349	0.9661	0.9829
No log	1.8557	180	0.8935	0.4335	0.8935	0.9452
No log	1.8763	182	0.8963	0.3543	0.8963	0.9468
No log	1.8969	184	0.9002	0.3543	0.9002	0.9488
No log	1.9175	186	0.9177	0.3543	0.9177	0.9580
No log	1.9381	188	0.8957	0.3250	0.8957	0.9464
No log	1.9588	190	0.9474	0.3107	0.9474	0.9733
No log	1.9794	192	0.9486	0.3404	0.9486	0.9740
No log	2.0	194	0.9436	0.4174	0.9436	0.9714
No log	2.0206	196	0.9340	0.4203	0.9340	0.9664
No log	2.0412	198	0.8760	0.4712	0.8760	0.9359
No log	2.0619	200	0.8414	0.4628	0.8414	0.9173
No log	2.0825	202	0.8810	0.4954	0.8810	0.9386
No log	2.1031	204	0.8879	0.4951	0.8879	0.9423
No log	2.1237	206	0.8407	0.4465	0.8407	0.9169
No log	2.1443	208	0.8362	0.4254	0.8362	0.9144
No log	2.1649	210	0.8448	0.3874	0.8448	0.9191
No log	2.1856	212	0.8785	0.3658	0.8785	0.9373
No log	2.2062	214	0.9177	0.4075	0.9177	0.9579
No log	2.2268	216	0.9879	0.4224	0.9879	0.9939
No log	2.2474	218	1.1536	0.3759	1.1536	1.0741
No log	2.2680	220	1.1319	0.4202	1.1319	1.0639
No log	2.2887	222	0.9605	0.4102	0.9605	0.9800
No log	2.3093	224	0.8732	0.3548	0.8732	0.9345
No log	2.3299	226	0.9324	0.3533	0.9324	0.9656
No log	2.3505	228	0.9261	0.3533	0.9261	0.9623
No log	2.3711	230	0.8589	0.3117	0.8589	0.9268
No log	2.3918	232	0.9430	0.3782	0.9430	0.9711
No log	2.4124	234	1.1587	0.3353	1.1587	1.0764
No log	2.4330	236	1.2620	0.2915	1.2620	1.1234
No log	2.4536	238	1.1395	0.3421	1.1395	1.0675
No log	2.4742	240	0.9332	0.4318	0.9332	0.9660
No log	2.4948	242	0.8653	0.4093	0.8653	0.9302
No log	2.5155	244	0.8868	0.4093	0.8868	0.9417
No log	2.5361	246	0.9636	0.4357	0.9636	0.9816
No log	2.5567	248	1.1455	0.3624	1.1456	1.0703
No log	2.5773	250	1.1285	0.3184	1.1285	1.0623
No log	2.5979	252	0.9643	0.4476	0.9643	0.9820
No log	2.6186	254	0.9096	0.3615	0.9096	0.9537
No log	2.6392	256	0.9171	0.3873	0.9171	0.9576
No log	2.6598	258	0.9163	0.3873	0.9163	0.9572
No log	2.6804	260	0.8944	0.4288	0.8944	0.9457
No log	2.7010	262	0.9926	0.4253	0.9926	0.9963
No log	2.7216	264	1.1118	0.3785	1.1118	1.0544
No log	2.7423	266	1.1537	0.3302	1.1537	1.0741
No log	2.7629	268	1.0719	0.38	1.0719	1.0353
No log	2.7835	270	0.9369	0.4754	0.9369	0.9680
No log	2.8041	272	0.9067	0.4646	0.9067	0.9522
No log	2.8247	274	0.9143	0.4836	0.9143	0.9562
No log	2.8454	276	0.8961	0.4599	0.8961	0.9466
No log	2.8660	278	0.8679	0.4854	0.8679	0.9316
No log	2.8866	280	0.8869	0.4487	0.8869	0.9417
No log	2.9072	282	0.8708	0.4487	0.8708	0.9332
No log	2.9278	284	0.8281	0.5121	0.8281	0.9100
No log	2.9485	286	0.8050	0.4955	0.8050	0.8972
No log	2.9691	288	0.8119	0.4955	0.8119	0.9010
No log	2.9897	290	0.7762	0.5176	0.7762	0.8810
No log	3.0103	292	0.7996	0.5522	0.7996	0.8942
No log	3.0309	294	0.9323	0.4181	0.9323	0.9655
No log	3.0515	296	1.0215	0.3863	1.0215	1.0107
No log	3.0722	298	1.0261	0.3846	1.0261	1.0130
No log	3.0928	300	0.9174	0.4460	0.9174	0.9578
No log	3.1134	302	0.8259	0.4729	0.8259	0.9088
No log	3.1340	304	0.7998	0.4363	0.7998	0.8943
No log	3.1546	306	0.7709	0.4659	0.7709	0.8780
No log	3.1753	308	0.7528	0.4918	0.7528	0.8676
No log	3.1959	310	0.7598	0.5459	0.7598	0.8716
No log	3.2165	312	0.8021	0.5305	0.8021	0.8956
No log	3.2371	314	0.8107	0.4954	0.8107	0.9004
No log	3.2577	316	0.8075	0.5208	0.8075	0.8986
No log	3.2784	318	0.8694	0.4948	0.8694	0.9324
No log	3.2990	320	0.9105	0.4234	0.9105	0.9542
No log	3.3196	322	0.9765	0.4470	0.9765	0.9882
No log	3.3402	324	1.0052	0.4186	1.0052	1.0026
No log	3.3608	326	1.0198	0.3902	1.0198	1.0098
No log	3.3814	328	0.9433	0.4203	0.9433	0.9712
No log	3.4021	330	0.9090	0.4220	0.9090	0.9534
No log	3.4227	332	0.9230	0.4350	0.9230	0.9607
No log	3.4433	334	0.9618	0.4459	0.9618	0.9807
No log	3.4639	336	0.9200	0.4224	0.9200	0.9592
No log	3.4845	338	0.8630	0.4254	0.8630	0.9290
No log	3.5052	340	0.9098	0.4493	0.9098	0.9538
No log	3.5258	342	0.9072	0.4238	0.9072	0.9525
No log	3.5464	344	0.8551	0.4534	0.8551	0.9247
No log	3.5670	346	0.9632	0.4098	0.9632	0.9814
No log	3.5876	348	1.0588	0.4222	1.0588	1.0290
No log	3.6082	350	1.0562	0.4334	1.0562	1.0277
No log	3.6289	352	1.0394	0.3972	1.0394	1.0195
No log	3.6495	354	0.9783	0.4020	0.9783	0.9891
No log	3.6701	356	0.9421	0.3771	0.9421	0.9706
No log	3.6907	358	0.9661	0.4020	0.9661	0.9829
No log	3.7113	360	1.0119	0.375	1.0119	1.0059
No log	3.7320	362	0.9793	0.3434	0.9793	0.9896
No log	3.7526	364	1.0090	0.3691	1.0090	1.0045
No log	3.7732	366	1.0005	0.3691	1.0005	1.0002
No log	3.7938	368	1.0048	0.3714	1.0048	1.0024
No log	3.8144	370	1.0221	0.3972	1.0221	1.0110
No log	3.8351	372	0.9807	0.3939	0.9807	0.9903
No log	3.8557	374	0.9362	0.3747	0.9362	0.9676
No log	3.8763	376	0.9085	0.3914	0.9085	0.9531
No log	3.8969	378	0.8951	0.4534	0.8951	0.9461
No log	3.9175	380	0.9327	0.4224	0.9327	0.9657
No log	3.9381	382	1.0035	0.4039	1.0035	1.0018
No log	3.9588	384	0.9932	0.3222	0.9932	0.9966
No log	3.9794	386	0.9671	0.2748	0.9671	0.9834
No log	4.0	388	0.9195	0.2771	0.9195	0.9589
No log	4.0206	390	0.8742	0.2986	0.8742	0.9350
No log	4.0412	392	0.8511	0.4385	0.8511	0.9225
No log	4.0619	394	0.8591	0.4503	0.8591	0.9269
No log	4.0825	396	0.8900	0.4241	0.8900	0.9434
No log	4.1031	398	0.9598	0.4310	0.9598	0.9797
No log	4.1237	400	0.9548	0.3921	0.9548	0.9771
No log	4.1443	402	0.8858	0.3085	0.8858	0.9412
No log	4.1649	404	0.8291	0.3112	0.8291	0.9106
No log	4.1856	406	0.8188	0.3896	0.8188	0.9049
No log	4.2062	408	0.8089	0.4030	0.8089	0.8994
No log	4.2268	410	0.8002	0.4629	0.8002	0.8945
No log	4.2474	412	0.8042	0.4487	0.8042	0.8968
No log	4.2680	414	0.8148	0.4726	0.8148	0.9027
No log	4.2887	416	0.8102	0.4726	0.8102	0.9001
No log	4.3093	418	0.7988	0.4757	0.7988	0.8938
No log	4.3299	420	0.8005	0.3896	0.8005	0.8947
No log	4.3505	422	0.8099	0.3628	0.8099	0.9000
No log	4.3711	424	0.8197	0.4010	0.8197	0.9054
No log	4.3918	426	0.7998	0.3513	0.7998	0.8943
No log	4.4124	428	0.8456	0.4312	0.8456	0.9196
No log	4.4330	430	0.8557	0.3953	0.8557	0.9251
No log	4.4536	432	0.8407	0.4590	0.8407	0.9169
No log	4.4742	434	0.7908	0.5010	0.7908	0.8893
No log	4.4948	436	0.8393	0.4723	0.8393	0.9161
No log	4.5155	438	0.9042	0.4723	0.9042	0.9509
No log	4.5361	440	0.9248	0.4709	0.9248	0.9617
No log	4.5567	442	0.8929	0.4471	0.8929	0.9449
No log	4.5773	444	0.8260	0.4097	0.8260	0.9088
No log	4.5979	446	0.7937	0.4563	0.7937	0.8909
No log	4.6186	448	0.7931	0.3737	0.7931	0.8905
No log	4.6392	450	0.8003	0.3737	0.8003	0.8946
No log	4.6598	452	0.8596	0.3802	0.8596	0.9272
No log	4.6804	454	0.9144	0.4326	0.9144	0.9563
No log	4.7010	456	0.9001	0.4071	0.9001	0.9487
No log	4.7216	458	0.8339	0.3777	0.8339	0.9132
No log	4.7423	460	0.8350	0.3590	0.8350	0.9138
No log	4.7629	462	0.8468	0.3733	0.8468	0.9202
No log	4.7835	464	0.8220	0.3877	0.8220	0.9066
No log	4.8041	466	0.8152	0.4612	0.8152	0.9029
No log	4.8247	468	0.8521	0.4487	0.8521	0.9231
No log	4.8454	470	0.8710	0.3940	0.8710	0.9333
No log	4.8660	472	0.8628	0.3658	0.8628	0.9289
No log	4.8866	474	0.8264	0.4854	0.8264	0.9091
No log	4.9072	476	0.8039	0.4873	0.8039	0.8966
No log	4.9278	478	0.7970	0.5002	0.7970	0.8928
No log	4.9485	480	0.8150	0.4742	0.8150	0.9028
No log	4.9691	482	0.8337	0.4854	0.8337	0.9130
No log	4.9897	484	0.8993	0.4335	0.8993	0.9483
No log	5.0103	486	0.9484	0.4696	0.9484	0.9739
No log	5.0309	488	0.8948	0.4335	0.8948	0.9459
No log	5.0515	490	0.8137	0.3959	0.8137	0.9020
No log	5.0722	492	0.8263	0.3773	0.8263	0.9090
No log	5.0928	494	0.8400	0.3265	0.8400	0.9165
No log	5.1134	496	0.8168	0.3773	0.8168	0.9038
No log	5.1340	498	0.7919	0.3896	0.7919	0.8899
0.2933	5.1546	500	0.7982	0.4974	0.7982	0.8934
0.2933	5.1753	502	0.8189	0.4974	0.8189	0.9050
0.2933	5.1959	504	0.8204	0.4742	0.8204	0.9058
0.2933	5.2165	506	0.8432	0.3941	0.8432	0.9183
0.2933	5.2371	508	0.8380	0.3977	0.8380	0.9154
0.2933	5.2577	510	0.8665	0.3941	0.8665	0.9308

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1