ArabicNewSplits6_FineTuningAraBERT_run1_AugV5_k17_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0136
• Qwk: 0.6081
• Mse: 1.0136
• Rmse: 1.0068

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0323	2	2.3597	0.0137	2.3597	1.5361
No log	0.0645	4	1.6511	0.1067	1.6511	1.2849
No log	0.0968	6	1.7238	-0.0364	1.7238	1.3129
No log	0.1290	8	1.9312	-0.0502	1.9312	1.3897
No log	0.1613	10	1.7276	-0.0389	1.7276	1.3144
No log	0.1935	12	1.4113	0.1575	1.4113	1.1880
No log	0.2258	14	1.5092	0.1071	1.5092	1.2285
No log	0.2581	16	1.7671	0.2325	1.7671	1.3293
No log	0.2903	18	1.7361	0.1233	1.7361	1.3176
No log	0.3226	20	1.7153	0.1453	1.7153	1.3097
No log	0.3548	22	1.6502	0.1019	1.6502	1.2846
No log	0.3871	24	1.5160	0.0492	1.5160	1.2313
No log	0.4194	26	1.5019	0.1363	1.5019	1.2255
No log	0.4516	28	1.4458	0.1237	1.4458	1.2024
No log	0.4839	30	1.4567	0.1806	1.4567	1.2070
No log	0.5161	32	1.5433	0.2435	1.5433	1.2423
No log	0.5484	34	1.4917	0.2188	1.4917	1.2214
No log	0.5806	36	1.4121	0.1668	1.4121	1.1883
No log	0.6129	38	1.3611	0.1761	1.3611	1.1667
No log	0.6452	40	1.3115	0.2658	1.3115	1.1452
No log	0.6774	42	1.3043	0.2998	1.3043	1.1421
No log	0.7097	44	1.2377	0.3330	1.2377	1.1125
No log	0.7419	46	1.2280	0.4234	1.2280	1.1082
No log	0.7742	48	1.2776	0.4323	1.2776	1.1303
No log	0.8065	50	1.2195	0.3895	1.2195	1.1043
No log	0.8387	52	1.2000	0.4404	1.2000	1.0954
No log	0.8710	54	1.2309	0.4513	1.2309	1.1095
No log	0.9032	56	1.2831	0.4766	1.2831	1.1327
No log	0.9355	58	1.2587	0.4990	1.2587	1.1219
No log	0.9677	60	1.2049	0.4423	1.2049	1.0977
No log	1.0	62	1.3035	0.4667	1.3035	1.1417
No log	1.0323	64	1.3146	0.4392	1.3146	1.1466
No log	1.0645	66	1.2447	0.3834	1.2447	1.1157
No log	1.0968	68	1.2655	0.3773	1.2655	1.1249
No log	1.1290	70	1.3669	0.3814	1.3669	1.1692
No log	1.1613	72	1.4613	0.3685	1.4613	1.2088
No log	1.1935	74	1.5267	0.3782	1.5267	1.2356
No log	1.2258	76	1.5628	0.4057	1.5628	1.2501
No log	1.2581	78	1.5086	0.3967	1.5086	1.2282
No log	1.2903	80	1.4339	0.4165	1.4339	1.1974
No log	1.3226	82	1.2868	0.4413	1.2868	1.1344
No log	1.3548	84	1.1735	0.4960	1.1735	1.0833
No log	1.3871	86	1.1476	0.5179	1.1476	1.0713
No log	1.4194	88	1.3084	0.5241	1.3084	1.1439
No log	1.4516	90	1.3111	0.5180	1.3111	1.1450
No log	1.4839	92	1.1827	0.5487	1.1827	1.0875
No log	1.5161	94	0.9857	0.5677	0.9857	0.9928
No log	1.5484	96	0.9532	0.5791	0.9532	0.9763
No log	1.5806	98	1.0059	0.5830	1.0059	1.0030
No log	1.6129	100	1.1477	0.5409	1.1477	1.0713
No log	1.6452	102	1.1654	0.5439	1.1654	1.0795
No log	1.6774	104	1.3033	0.5226	1.3033	1.1416
No log	1.7097	106	1.7367	0.4602	1.7367	1.3178
No log	1.7419	108	1.9469	0.3644	1.9469	1.3953
No log	1.7742	110	1.7884	0.3724	1.7884	1.3373
No log	1.8065	112	1.3603	0.5048	1.3603	1.1663
No log	1.8387	114	0.9953	0.5005	0.9953	0.9976
No log	1.8710	116	0.9202	0.6022	0.9202	0.9592
No log	1.9032	118	0.9409	0.5579	0.9409	0.9700
No log	1.9355	120	0.9334	0.5656	0.9334	0.9661
No log	1.9677	122	0.9237	0.5924	0.9237	0.9611
No log	2.0	124	1.0409	0.4722	1.0409	1.0202
No log	2.0323	126	1.3237	0.4803	1.3237	1.1505
No log	2.0645	128	1.7650	0.2876	1.7650	1.3285
No log	2.0968	130	2.0985	0.2657	2.0985	1.4486
No log	2.1290	132	1.9709	0.2792	1.9709	1.4039
No log	2.1613	134	1.6024	0.3673	1.6024	1.2659
No log	2.1935	136	1.2725	0.4794	1.2725	1.1280
No log	2.2258	138	1.1351	0.4939	1.1351	1.0654
No log	2.2581	140	1.1712	0.4817	1.1712	1.0822
No log	2.2903	142	1.3756	0.4700	1.3756	1.1728
No log	2.3226	144	1.4824	0.4526	1.4824	1.2175
No log	2.3548	146	1.3917	0.4990	1.3917	1.1797
No log	2.3871	148	1.3215	0.5260	1.3215	1.1495
No log	2.4194	150	1.2305	0.5210	1.2305	1.1093
No log	2.4516	152	1.0878	0.5403	1.0878	1.0430
No log	2.4839	154	1.0766	0.5628	1.0766	1.0376
No log	2.5161	156	1.2687	0.5362	1.2687	1.1264
No log	2.5484	158	1.3366	0.5409	1.3366	1.1561
No log	2.5806	160	1.2528	0.5480	1.2528	1.1193
No log	2.6129	162	1.2479	0.5446	1.2479	1.1171
No log	2.6452	164	1.2789	0.5320	1.2789	1.1309
No log	2.6774	166	1.1839	0.5202	1.1839	1.0881
No log	2.7097	168	1.0601	0.5653	1.0601	1.0296
No log	2.7419	170	1.0548	0.5580	1.0548	1.0270
No log	2.7742	172	1.0073	0.5722	1.0073	1.0036
No log	2.8065	174	1.0520	0.5590	1.0520	1.0257
No log	2.8387	176	0.9953	0.5710	0.9953	0.9977
No log	2.8710	178	0.9827	0.5914	0.9827	0.9913
No log	2.9032	180	0.9664	0.6074	0.9664	0.9830
No log	2.9355	182	1.0439	0.6206	1.0439	1.0217
No log	2.9677	184	0.9675	0.6515	0.9675	0.9836
No log	3.0	186	0.9870	0.6441	0.9870	0.9935
No log	3.0323	188	1.0709	0.6119	1.0709	1.0349
No log	3.0645	190	1.1610	0.5968	1.1610	1.0775
No log	3.0968	192	1.0697	0.5584	1.0697	1.0342
No log	3.1290	194	0.8600	0.5939	0.8600	0.9273
No log	3.1613	196	0.7829	0.5864	0.7829	0.8848
No log	3.1935	198	0.7916	0.5781	0.7916	0.8897
No log	3.2258	200	0.8748	0.6045	0.8748	0.9353
No log	3.2581	202	0.9861	0.5932	0.9861	0.9930
No log	3.2903	204	0.9994	0.5932	0.9994	0.9997
No log	3.3226	206	0.9346	0.6097	0.9346	0.9667
No log	3.3548	208	0.9514	0.6111	0.9514	0.9754
No log	3.3871	210	0.9855	0.5922	0.9855	0.9927
No log	3.4194	212	0.8773	0.6157	0.8773	0.9366
No log	3.4516	214	0.7789	0.6338	0.7789	0.8826
No log	3.4839	216	0.7614	0.6408	0.7614	0.8726
No log	3.5161	218	0.8140	0.6284	0.8140	0.9022
No log	3.5484	220	0.9750	0.5998	0.9750	0.9874
No log	3.5806	222	1.0430	0.5758	1.0430	1.0213
No log	3.6129	224	1.0225	0.5758	1.0225	1.0112
No log	3.6452	226	0.9336	0.6111	0.9336	0.9663
No log	3.6774	228	0.9256	0.6074	0.9256	0.9621
No log	3.7097	230	0.8542	0.6243	0.8542	0.9242
No log	3.7419	232	0.8550	0.6351	0.8550	0.9246
No log	3.7742	234	0.9510	0.6416	0.9510	0.9752
No log	3.8065	236	1.1474	0.6032	1.1474	1.0712
No log	3.8387	238	1.3704	0.5663	1.3704	1.1706
No log	3.8710	240	1.3193	0.5889	1.3193	1.1486
No log	3.9032	242	1.0726	0.6137	1.0726	1.0357
No log	3.9355	244	0.8635	0.6496	0.8635	0.9292
No log	3.9677	246	0.8291	0.6547	0.8291	0.9105
No log	4.0	248	0.8780	0.6351	0.8780	0.9370
No log	4.0323	250	1.0277	0.6056	1.0277	1.0137
No log	4.0645	252	1.1767	0.5703	1.1767	1.0847
No log	4.0968	254	1.1740	0.5554	1.1740	1.0835
No log	4.1290	256	1.0169	0.5548	1.0169	1.0084
No log	4.1613	258	0.8673	0.5838	0.8673	0.9313
No log	4.1935	260	0.8343	0.5685	0.8343	0.9134
No log	4.2258	262	0.8391	0.5685	0.8391	0.9160
No log	4.2581	264	0.8810	0.5797	0.8810	0.9386
No log	4.2903	266	0.9155	0.5721	0.9155	0.9568
No log	4.3226	268	0.8955	0.5883	0.8955	0.9463
No log	4.3548	270	0.8424	0.5858	0.8424	0.9178
No log	4.3871	272	0.8779	0.6229	0.8779	0.9370
No log	4.4194	274	0.9744	0.6041	0.9744	0.9871
No log	4.4516	276	1.0412	0.5783	1.0412	1.0204
No log	4.4839	278	1.2039	0.5760	1.2039	1.0972
No log	4.5161	280	1.2524	0.5729	1.2524	1.1191
No log	4.5484	282	1.1330	0.5794	1.1330	1.0644
No log	4.5806	284	1.0365	0.5862	1.0365	1.0181
No log	4.6129	286	0.9113	0.6111	0.9113	0.9546
No log	4.6452	288	0.8372	0.5769	0.8372	0.9150
No log	4.6774	290	0.8266	0.5743	0.8266	0.9092
No log	4.7097	292	0.8591	0.5993	0.8591	0.9269
No log	4.7419	294	0.9086	0.6125	0.9086	0.9532
No log	4.7742	296	0.9573	0.6136	0.9573	0.9784
No log	4.8065	298	0.9306	0.6215	0.9306	0.9647
No log	4.8387	300	0.8559	0.6150	0.8559	0.9252
No log	4.8710	302	0.8723	0.6089	0.8723	0.9340
No log	4.9032	304	0.9417	0.6179	0.9417	0.9704
No log	4.9355	306	0.9880	0.6081	0.9880	0.9940
No log	4.9677	308	1.0170	0.5988	1.0170	1.0084
No log	5.0	310	1.0847	0.5930	1.0847	1.0415
No log	5.0323	312	1.1231	0.5805	1.1231	1.0597
No log	5.0645	314	1.0735	0.5930	1.0735	1.0361
No log	5.0968	316	0.9546	0.6079	0.9546	0.9770
No log	5.1290	318	0.8846	0.5978	0.8846	0.9405
No log	5.1613	320	0.8664	0.5674	0.8664	0.9308
No log	5.1935	322	0.8999	0.5863	0.8999	0.9486
No log	5.2258	324	0.9204	0.5846	0.9204	0.9594
No log	5.2581	326	0.9344	0.5933	0.9344	0.9667
No log	5.2903	328	0.9742	0.6068	0.9742	0.9870
No log	5.3226	330	0.9232	0.6107	0.9232	0.9608
No log	5.3548	332	0.8501	0.6226	0.8501	0.9220
No log	5.3871	334	0.8334	0.6268	0.8334	0.9129
No log	5.4194	336	0.8727	0.6147	0.8727	0.9342
No log	5.4516	338	0.9706	0.6231	0.9706	0.9852
No log	5.4839	340	1.0142	0.6186	1.0142	1.0071
No log	5.5161	342	1.0573	0.6148	1.0573	1.0282
No log	5.5484	344	1.0538	0.6023	1.0538	1.0266
No log	5.5806	346	0.9874	0.6081	0.9874	0.9937
No log	5.6129	348	0.9876	0.6081	0.9876	0.9938
No log	5.6452	350	1.0352	0.6023	1.0352	1.0174
No log	5.6774	352	1.0078	0.6148	1.0078	1.0039
No log	5.7097	354	1.0063	0.6148	1.0063	1.0031
No log	5.7419	356	1.0172	0.6023	1.0172	1.0086
No log	5.7742	358	1.0065	0.6010	1.0065	1.0032
No log	5.8065	360	0.9876	0.6023	0.9876	0.9938
No log	5.8387	362	0.9335	0.6159	0.9335	0.9662
No log	5.8710	364	0.9333	0.5784	0.9333	0.9661
No log	5.9032	366	0.9954	0.5845	0.9954	0.9977
No log	5.9355	368	1.1316	0.5714	1.1316	1.0638
No log	5.9677	370	1.2195	0.5851	1.2195	1.1043
No log	6.0	372	1.2165	0.5871	1.2165	1.1030
No log	6.0323	374	1.1372	0.5771	1.1372	1.0664
No log	6.0645	376	1.0657	0.5817	1.0657	1.0323
No log	6.0968	378	1.0515	0.5828	1.0515	1.0254
No log	6.1290	380	1.0341	0.5828	1.0341	1.0169
No log	6.1613	382	0.9953	0.5686	0.9953	0.9976
No log	6.1935	384	0.9735	0.5686	0.9735	0.9867
No log	6.2258	386	0.9686	0.5711	0.9686	0.9842
No log	6.2581	388	0.9262	0.6046	0.9262	0.9624
No log	6.2903	390	0.9127	0.5972	0.9127	0.9553
No log	6.3226	392	0.8982	0.5935	0.8982	0.9477
No log	6.3548	394	0.8584	0.5993	0.8584	0.9265
No log	6.3871	396	0.8238	0.5966	0.8238	0.9077
No log	6.4194	398	0.8425	0.5894	0.8425	0.9179
No log	6.4516	400	0.8624	0.5910	0.8624	0.9286
No log	6.4839	402	0.9163	0.5772	0.9163	0.9572
No log	6.5161	404	1.0001	0.5554	1.0001	1.0000
No log	6.5484	406	1.0090	0.5612	1.0090	1.0045
No log	6.5806	408	1.0080	0.5612	1.0080	1.0040
No log	6.6129	410	0.9817	0.5612	0.9817	0.9908
No log	6.6452	412	0.9881	0.5612	0.9881	0.9941
No log	6.6774	414	1.0475	0.5806	1.0475	1.0235
No log	6.7097	416	1.0595	0.5876	1.0595	1.0293
No log	6.7419	418	1.0506	0.6004	1.0506	1.0250
No log	6.7742	420	1.1109	0.6015	1.1109	1.0540
No log	6.8065	422	1.1800	0.5858	1.1800	1.0863
No log	6.8387	424	1.2190	0.5866	1.2190	1.1041
No log	6.8710	426	1.1693	0.5947	1.1693	1.0813
No log	6.9032	428	1.0671	0.6086	1.0671	1.0330
No log	6.9355	430	0.9897	0.6042	0.9897	0.9949
No log	6.9677	432	0.9456	0.6111	0.9456	0.9724
No log	7.0	434	0.9495	0.5940	0.9495	0.9744
No log	7.0323	436	0.9856	0.6078	0.9856	0.9928
No log	7.0645	438	1.0515	0.6086	1.0515	1.0254
No log	7.0968	440	1.1063	0.5871	1.1063	1.0518
No log	7.1290	442	1.1010	0.5871	1.1010	1.0493
No log	7.1613	444	1.1231	0.5871	1.1231	1.0598
No log	7.1935	446	1.0885	0.5994	1.0885	1.0433
No log	7.2258	448	1.0127	0.6033	1.0127	1.0063
No log	7.2581	450	0.9468	0.5979	0.9468	0.9730
No log	7.2903	452	0.9342	0.5979	0.9342	0.9666
No log	7.3226	454	0.9360	0.5979	0.9360	0.9675
No log	7.3548	456	0.9826	0.5965	0.9826	0.9912
No log	7.3871	458	1.0420	0.5942	1.0420	1.0208
No log	7.4194	460	1.1048	0.6010	1.1048	1.0511
No log	7.4516	462	1.0994	0.6010	1.0994	1.0485
No log	7.4839	464	1.0871	0.6010	1.0871	1.0426
No log	7.5161	466	1.0758	0.5885	1.0758	1.0372
No log	7.5484	468	1.0436	0.6004	1.0436	1.0216
No log	7.5806	470	1.0128	0.5935	1.0128	1.0064
No log	7.6129	472	1.0142	0.5935	1.0142	1.0071
No log	7.6452	474	1.0277	0.5935	1.0277	1.0137
No log	7.6774	476	1.0219	0.5935	1.0219	1.0109
No log	7.7097	478	1.0438	0.5876	1.0438	1.0217
No log	7.7419	480	1.0212	0.5935	1.0212	1.0105
No log	7.7742	482	1.0081	0.5935	1.0081	1.0040
No log	7.8065	484	1.0272	0.5955	1.0272	1.0135
No log	7.8387	486	1.0195	0.5955	1.0195	1.0097
No log	7.8710	488	1.0036	0.5955	1.0036	1.0018
No log	7.9032	490	0.9940	0.6063	0.9940	0.9970
No log	7.9355	492	0.9764	0.5994	0.9764	0.9881
No log	7.9677	494	0.9746	0.5994	0.9746	0.9872
No log	8.0	496	0.9742	0.5994	0.9742	0.9870
No log	8.0323	498	0.9721	0.5994	0.9721	0.9859
0.3426	8.0645	500	0.9779	0.6063	0.9779	0.9889
0.3426	8.0968	502	0.9965	0.6081	0.9965	0.9983
0.3426	8.1290	504	1.0076	0.6081	1.0076	1.0038
0.3426	8.1613	506	1.0313	0.6081	1.0313	1.0155
0.3426	8.1935	508	1.0518	0.6148	1.0518	1.0256
0.3426	8.2258	510	1.0472	0.6148	1.0472	1.0233
0.3426	8.2581	512	1.0417	0.6148	1.0417	1.0206
0.3426	8.2903	514	1.0059	0.6081	1.0059	1.0029
0.3426	8.3226	516	0.9758	0.6081	0.9758	0.9878
0.3426	8.3548	518	0.9509	0.6109	0.9509	0.9751
0.3426	8.3871	520	0.9261	0.6119	0.9261	0.9624
0.3426	8.4194	522	0.9243	0.6119	0.9243	0.9614
0.3426	8.4516	524	0.9086	0.6051	0.9086	0.9532
0.3426	8.4839	526	0.8934	0.6006	0.8934	0.9452
0.3426	8.5161	528	0.9058	0.6042	0.9058	0.9517
0.3426	8.5484	530	0.9410	0.6027	0.9410	0.9701
0.3426	8.5806	532	0.9937	0.5955	0.9937	0.9968
0.3426	8.6129	534	1.0290	0.6023	1.0290	1.0144
0.3426	8.6452	536	1.0579	0.6023	1.0579	1.0285
0.3426	8.6774	538	1.1050	0.5917	1.1050	1.0512
0.3426	8.7097	540	1.1397	0.5873	1.1397	1.0676
0.3426	8.7419	542	1.1426	0.5873	1.1426	1.0689
0.3426	8.7742	544	1.1454	0.5873	1.1454	1.0703
0.3426	8.8065	546	1.1359	0.5917	1.1359	1.0658
0.3426	8.8387	548	1.1103	0.5917	1.1103	1.0537
0.3426	8.8710	550	1.0897	0.6010	1.0897	1.0439
0.3426	8.9032	552	1.0840	0.6023	1.0840	1.0412
0.3426	8.9355	554	1.0676	0.6023	1.0676	1.0333
0.3426	8.9677	556	1.0522	0.6023	1.0522	1.0258
0.3426	9.0	558	1.0361	0.6081	1.0361	1.0179
0.3426	9.0323	560	1.0275	0.6081	1.0275	1.0137
0.3426	9.0645	562	1.0112	0.6081	1.0112	1.0056
0.3426	9.0968	564	1.0062	0.6081	1.0062	1.0031
0.3426	9.1290	566	1.0097	0.6081	1.0097	1.0048
0.3426	9.1613	568	0.9963	0.6127	0.9963	0.9982
0.3426	9.1935	570	0.9781	0.6127	0.9781	0.9890
0.3426	9.2258	572	0.9605	0.6091	0.9605	0.9801
0.3426	9.2581	574	0.9559	0.6024	0.9559	0.9777
0.3426	9.2903	576	0.9660	0.6127	0.9660	0.9829
0.3426	9.3226	578	0.9834	0.6127	0.9834	0.9916
0.3426	9.3548	580	0.9894	0.6127	0.9894	0.9947
0.3426	9.3871	582	0.9971	0.6081	0.9971	0.9986
0.3426	9.4194	584	1.0024	0.6081	1.0024	1.0012
0.3426	9.4516	586	1.0071	0.6081	1.0071	1.0035
0.3426	9.4839	588	1.0165	0.6081	1.0165	1.0082
0.3426	9.5161	590	1.0218	0.6081	1.0218	1.0109
0.3426	9.5484	592	1.0303	0.6081	1.0303	1.0150
0.3426	9.5806	594	1.0347	0.6081	1.0347	1.0172
0.3426	9.6129	596	1.0311	0.6081	1.0311	1.0154
0.3426	9.6452	598	1.0273	0.6081	1.0273	1.0136
0.3426	9.6774	600	1.0251	0.6081	1.0251	1.0125
0.3426	9.7097	602	1.0206	0.6081	1.0206	1.0103
0.3426	9.7419	604	1.0188	0.6081	1.0188	1.0093
0.3426	9.7742	606	1.0173	0.6081	1.0173	1.0086
0.3426	9.8065	608	1.0166	0.6081	1.0166	1.0083
0.3426	9.8387	610	1.0149	0.6081	1.0149	1.0074
0.3426	9.8710	612	1.0155	0.6081	1.0155	1.0077
0.3426	9.9032	614	1.0156	0.6081	1.0156	1.0078
0.3426	9.9355	616	1.0148	0.6081	1.0148	1.0074
0.3426	9.9677	618	1.0141	0.6081	1.0141	1.0070
0.3426	10.0	620	1.0136	0.6081	1.0136	1.0068

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1