ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k12_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3397
• Qwk: 0.2144
• Mse: 1.3397
• Rmse: 1.1575

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0351	2	4.1593	0.0086	4.1593	2.0394
No log	0.0702	4	2.2567	0.0292	2.2567	1.5022
No log	0.1053	6	1.5412	0.0398	1.5412	1.2415
No log	0.1404	8	1.1874	0.2569	1.1874	1.0897
No log	0.1754	10	1.0207	0.2187	1.0207	1.0103
No log	0.2105	12	1.0517	0.1629	1.0517	1.0255
No log	0.2456	14	1.0793	0.2841	1.0793	1.0389
No log	0.2807	16	1.1080	0.3014	1.1080	1.0526
No log	0.3158	18	0.9998	0.2424	0.9998	0.9999
No log	0.3509	20	1.2735	0.1343	1.2735	1.1285
No log	0.3860	22	1.3299	0.0841	1.3299	1.1532
No log	0.4211	24	1.0754	0.3182	1.0754	1.0370
No log	0.4561	26	1.1611	0.1739	1.1611	1.0776
No log	0.4912	28	1.4426	0.1500	1.4426	1.2011
No log	0.5263	30	1.3243	0.2098	1.3243	1.1508
No log	0.5614	32	1.0214	0.2713	1.0214	1.0106
No log	0.5965	34	1.1302	0.2947	1.1302	1.0631
No log	0.6316	36	1.1143	0.3236	1.1143	1.0556
No log	0.6667	38	1.0138	0.2842	1.0138	1.0069
No log	0.7018	40	1.0617	0.1858	1.0617	1.0304
No log	0.7368	42	1.1308	0.1379	1.1308	1.0634
No log	0.7719	44	1.0631	0.1858	1.0631	1.0311
No log	0.8070	46	0.9942	0.2888	0.9942	0.9971
No log	0.8421	48	0.9862	0.3367	0.9862	0.9931
No log	0.8772	50	1.0610	0.2233	1.0610	1.0300
No log	0.9123	52	1.3194	0.2177	1.3194	1.1487
No log	0.9474	54	1.2030	0.2857	1.2030	1.0968
No log	0.9825	56	1.0956	0.3296	1.0956	1.0467
No log	1.0175	58	1.1245	0.2787	1.1245	1.0604
No log	1.0526	60	1.1313	0.3256	1.1313	1.0636
No log	1.0877	62	1.1195	0.2011	1.1195	1.0581
No log	1.1228	64	1.1387	0.2864	1.1387	1.0671
No log	1.1579	66	1.0543	0.3323	1.0543	1.0268
No log	1.1930	68	1.0737	0.2400	1.0737	1.0362
No log	1.2281	70	1.0898	0.2505	1.0898	1.0439
No log	1.2632	72	1.0348	0.2287	1.0348	1.0172
No log	1.2982	74	1.0404	0.2408	1.0404	1.0200
No log	1.3333	76	0.9867	0.3583	0.9867	0.9933
No log	1.3684	78	1.0153	0.3192	1.0153	1.0076
No log	1.4035	80	1.1649	0.2731	1.1649	1.0793
No log	1.4386	82	1.0622	0.3387	1.0622	1.0306
No log	1.4737	84	1.0107	0.3931	1.0107	1.0053
No log	1.5088	86	1.1268	0.2970	1.1268	1.0615
No log	1.5439	88	1.1479	0.3361	1.1479	1.0714
No log	1.5789	90	1.0601	0.3327	1.0601	1.0296
No log	1.6140	92	1.0752	0.3002	1.0752	1.0369
No log	1.6491	94	1.1144	0.2608	1.1144	1.0556
No log	1.6842	96	1.1663	0.3615	1.1663	1.0799
No log	1.7193	98	1.3932	0.0228	1.3932	1.1803
No log	1.7544	100	1.5331	-0.0397	1.5331	1.2382
No log	1.7895	102	1.4514	0.0087	1.4514	1.2047
No log	1.8246	104	1.2730	0.1525	1.2730	1.1283
No log	1.8596	106	1.0931	0.3217	1.0931	1.0455
No log	1.8947	108	1.0039	0.2743	1.0039	1.0020
No log	1.9298	110	1.1111	0.3099	1.1111	1.0541
No log	1.9649	112	1.1801	0.3079	1.1801	1.0863
No log	2.0	114	1.2478	0.2619	1.2478	1.1170
No log	2.0351	116	1.1443	0.3371	1.1443	1.0697
No log	2.0702	118	1.0152	0.2931	1.0152	1.0076
No log	2.1053	120	0.9865	0.3035	0.9865	0.9932
No log	2.1404	122	1.0083	0.3318	1.0083	1.0041
No log	2.1754	124	1.1598	0.3156	1.1598	1.0769
No log	2.2105	126	1.4225	0.2283	1.4225	1.1927
No log	2.2456	128	1.4648	0.0946	1.4648	1.2103
No log	2.2807	130	1.3449	0.1952	1.3449	1.1597
No log	2.3158	132	1.1146	0.1823	1.1146	1.0557
No log	2.3509	134	0.9474	0.2391	0.9474	0.9734
No log	2.3860	136	0.9968	0.2880	0.9968	0.9984
No log	2.4211	138	0.9979	0.2151	0.9979	0.9989
No log	2.4561	140	0.9728	0.2424	0.9728	0.9863
No log	2.4912	142	1.0507	0.2698	1.0507	1.0251
No log	2.5263	144	1.1367	0.2384	1.1367	1.0662
No log	2.5614	146	1.2524	0.3156	1.2524	1.1191
No log	2.5965	148	1.3121	0.2749	1.3121	1.1455
No log	2.6316	150	1.2079	0.2452	1.2079	1.0991
No log	2.6667	152	1.0908	0.2192	1.0908	1.0444
No log	2.7018	154	1.0859	0.2072	1.0859	1.0421
No log	2.7368	156	1.1323	0.2553	1.1323	1.0641
No log	2.7719	158	1.1952	0.2416	1.1952	1.0932
No log	2.8070	160	1.2294	0.2981	1.2294	1.1088
No log	2.8421	162	1.2717	0.3391	1.2717	1.1277
No log	2.8772	164	1.2787	0.3400	1.2787	1.1308
No log	2.9123	166	1.2406	0.3316	1.2406	1.1138
No log	2.9474	168	1.2123	0.3157	1.2123	1.1010
No log	2.9825	170	1.0537	0.4326	1.0537	1.0265
No log	3.0175	172	1.0291	0.4081	1.0291	1.0145
No log	3.0526	174	1.0531	0.4326	1.0531	1.0262
No log	3.0877	176	1.1690	0.3679	1.1690	1.0812
No log	3.1228	178	1.2545	0.3380	1.2545	1.1200
No log	3.1579	180	1.1710	0.3641	1.1710	1.0821
No log	3.1930	182	1.1550	0.3205	1.1550	1.0747
No log	3.2281	184	1.2041	0.3470	1.2041	1.0973
No log	3.2632	186	1.3416	0.3237	1.3416	1.1583
No log	3.2982	188	1.4768	0.2336	1.4768	1.2152
No log	3.3333	190	1.4811	0.2511	1.4811	1.2170
No log	3.3684	192	1.3685	0.1835	1.3685	1.1698
No log	3.4035	194	1.2020	0.1868	1.2020	1.0964
No log	3.4386	196	1.0974	0.2077	1.0974	1.0476
No log	3.4737	198	1.1226	0.2680	1.1226	1.0595
No log	3.5088	200	1.2269	0.3363	1.2269	1.1077
No log	3.5439	202	1.2543	0.3004	1.2543	1.1200
No log	3.5789	204	1.2208	0.3391	1.2208	1.1049
No log	3.6140	206	1.1549	0.3400	1.1549	1.0747
No log	3.6491	208	1.1744	0.3400	1.1744	1.0837
No log	3.6842	210	1.2374	0.3163	1.2374	1.1124
No log	3.7193	212	1.2996	0.2495	1.2996	1.1400
No log	3.7544	214	1.2158	0.1500	1.2158	1.1026
No log	3.7895	216	1.1026	0.1900	1.1026	1.0501
No log	3.8246	218	1.0223	0.2276	1.0223	1.0111
No log	3.8596	220	1.0248	0.2791	1.0248	1.0123
No log	3.8947	222	1.1310	0.3792	1.1310	1.0635
No log	3.9298	224	1.2169	0.3471	1.2169	1.1031
No log	3.9649	226	1.2005	0.3608	1.2005	1.0957
No log	4.0	228	1.1832	0.1873	1.1832	1.0878
No log	4.0351	230	1.1470	0.1516	1.1470	1.0710
No log	4.0702	232	1.1483	0.2474	1.1483	1.0716
No log	4.1053	234	1.1696	0.3584	1.1696	1.0815
No log	4.1404	236	1.1155	0.3200	1.1155	1.0562
No log	4.1754	238	1.1844	0.3261	1.1844	1.0883
No log	4.2105	240	1.2303	0.3261	1.2303	1.1092
No log	4.2456	242	1.1373	0.3261	1.1373	1.0665
No log	4.2807	244	1.0804	0.3472	1.0804	1.0394
No log	4.3158	246	1.1202	0.2937	1.1202	1.0584
No log	4.3509	248	1.2484	0.2689	1.2484	1.1173
No log	4.3860	250	1.4261	0.2948	1.4261	1.1942
No log	4.4211	252	1.4104	0.2767	1.4104	1.1876
No log	4.4561	254	1.2092	0.3333	1.2092	1.0996
No log	4.4912	256	0.9940	0.4495	0.9940	0.9970
No log	4.5263	258	0.9510	0.3836	0.9510	0.9752
No log	4.5614	260	0.9449	0.3564	0.9449	0.9721
No log	4.5965	262	0.9707	0.4388	0.9707	0.9852
No log	4.6316	264	1.2040	0.3778	1.2040	1.0973
No log	4.6667	266	1.3121	0.3255	1.3121	1.1455
No log	4.7018	268	1.2235	0.3224	1.2235	1.1061
No log	4.7368	270	1.0666	0.3844	1.0666	1.0327
No log	4.7719	272	0.9495	0.3435	0.9495	0.9744
No log	4.8070	274	0.9304	0.3818	0.9304	0.9646
No log	4.8421	276	0.9341	0.3950	0.9341	0.9665
No log	4.8772	278	1.0151	0.3584	1.0151	1.0075
No log	4.9123	280	1.1040	0.3671	1.1040	1.0507
No log	4.9474	282	1.1973	0.3658	1.1973	1.0942
No log	4.9825	284	1.2348	0.3488	1.2348	1.1112
No log	5.0175	286	1.1386	0.2325	1.1386	1.0670
No log	5.0526	288	1.0674	0.1981	1.0674	1.0331
No log	5.0877	290	1.0752	0.2961	1.0752	1.0369
No log	5.1228	292	1.1671	0.3453	1.1671	1.0803
No log	5.1579	294	1.3007	0.3970	1.3007	1.1405
No log	5.1930	296	1.2825	0.3699	1.2825	1.1325
No log	5.2281	298	1.2199	0.4051	1.2199	1.1045
No log	5.2632	300	1.1435	0.2651	1.1435	1.0693
No log	5.2982	302	1.0853	0.2325	1.0853	1.0418
No log	5.3333	304	1.0076	0.1981	1.0076	1.0038
No log	5.3684	306	1.0063	0.1981	1.0063	1.0032
No log	5.4035	308	1.0797	0.2651	1.0797	1.0391
No log	5.4386	310	1.2457	0.3846	1.2457	1.1161
No log	5.4737	312	1.3968	0.3243	1.3968	1.1819
No log	5.5088	314	1.4163	0.3084	1.4163	1.1901
No log	5.5439	316	1.2701	0.3647	1.2701	1.1270
No log	5.5789	318	1.2302	0.3699	1.2302	1.1091
No log	5.6140	320	1.2031	0.3619	1.2031	1.0969
No log	5.6491	322	1.2152	0.3663	1.2152	1.1023
No log	5.6842	324	1.2529	0.3538	1.2529	1.1193
No log	5.7193	326	1.3987	0.3330	1.3987	1.1827
No log	5.7544	328	1.3557	0.3431	1.3557	1.1644
No log	5.7895	330	1.1162	0.3721	1.1162	1.0565
No log	5.8246	332	0.9392	0.3382	0.9392	0.9691
No log	5.8596	334	0.9099	0.3877	0.9099	0.9539
No log	5.8947	336	0.9174	0.3476	0.9174	0.9578
No log	5.9298	338	1.0179	0.3124	1.0179	1.0089
No log	5.9649	340	1.0884	0.3539	1.0884	1.0433
No log	6.0	342	1.0400	0.3824	1.0400	1.0198
No log	6.0351	344	0.9675	0.2600	0.9675	0.9836
No log	6.0702	346	0.9630	0.2887	0.9630	0.9813
No log	6.1053	348	0.9971	0.2721	0.9971	0.9985
No log	6.1404	350	1.0342	0.2647	1.0342	1.0169
No log	6.1754	352	1.1426	0.3310	1.1426	1.0689
No log	6.2105	354	1.1508	0.3310	1.1508	1.0728
No log	6.2456	356	1.1175	0.2723	1.1175	1.0571
No log	6.2807	358	1.1458	0.2857	1.1458	1.0704
No log	6.3158	360	1.2042	0.3043	1.2042	1.0974
No log	6.3509	362	1.2994	0.3344	1.2994	1.1399
No log	6.3860	364	1.3513	0.2583	1.3513	1.1625
No log	6.4211	366	1.4344	0.2311	1.4344	1.1977
No log	6.4561	368	1.4181	0.2770	1.4181	1.1908
No log	6.4912	370	1.3035	0.3562	1.3035	1.1417
No log	6.5263	372	1.0853	0.3062	1.0853	1.0418
No log	6.5614	374	0.9576	0.2865	0.9576	0.9786
No log	6.5965	376	0.9372	0.2449	0.9372	0.9681
No log	6.6316	378	0.9616	0.2314	0.9616	0.9806
No log	6.6667	380	1.0563	0.2651	1.0563	1.0277
No log	6.7018	382	1.1420	0.2331	1.1420	1.0687
No log	6.7368	384	1.2196	0.3496	1.2196	1.1044
No log	6.7719	386	1.2229	0.3864	1.2229	1.1059
No log	6.8070	388	1.1665	0.3741	1.1665	1.0800
No log	6.8421	390	1.1985	0.3741	1.1985	1.0948
No log	6.8772	392	1.1831	0.3081	1.1831	1.0877
No log	6.9123	394	1.1758	0.2175	1.1758	1.0844
No log	6.9474	396	1.2039	0.3374	1.2039	1.0972
No log	6.9825	398	1.2135	0.3654	1.2135	1.1016
No log	7.0175	400	1.2660	0.3741	1.2660	1.1251
No log	7.0526	402	1.2713	0.3761	1.2713	1.1275
No log	7.0877	404	1.2920	0.3761	1.2920	1.1367
No log	7.1228	406	1.2426	0.3761	1.2426	1.1147
No log	7.1579	408	1.0859	0.3717	1.0859	1.0421
No log	7.1930	410	1.0183	0.3383	1.0183	1.0091
No log	7.2281	412	1.0593	0.3956	1.0593	1.0292
No log	7.2632	414	1.1013	0.4123	1.1013	1.0494
No log	7.2982	416	1.0628	0.3879	1.0628	1.0309
No log	7.3333	418	1.0429	0.2878	1.0429	1.0212
No log	7.3684	420	1.0443	0.2791	1.0443	1.0219
No log	7.4035	422	1.0999	0.2887	1.0999	1.0488
No log	7.4386	424	1.2545	0.2273	1.2545	1.1200
No log	7.4737	426	1.4041	0.2411	1.4041	1.1849
No log	7.5088	428	1.3594	0.2446	1.3594	1.1659
No log	7.5439	430	1.1930	0.1770	1.1930	1.0923
No log	7.5789	432	1.0736	0.1653	1.0736	1.0361
No log	7.6140	434	1.0217	0.2400	1.0217	1.0108
No log	7.6491	436	0.9742	0.2572	0.9742	0.9870
No log	7.6842	438	0.9576	0.2988	0.9576	0.9786
No log	7.7193	440	0.9556	0.3293	0.9556	0.9776
No log	7.7544	442	0.9705	0.3358	0.9705	0.9851
No log	7.7895	444	0.9599	0.3263	0.9599	0.9797
No log	7.8246	446	0.9513	0.3091	0.9513	0.9754
No log	7.8596	448	0.9950	0.3087	0.9950	0.9975
No log	7.8947	450	1.0216	0.3409	1.0216	1.0107
No log	7.9298	452	1.0533	0.3811	1.0533	1.0263
No log	7.9649	454	0.9898	0.4143	0.9898	0.9949
No log	8.0	456	0.9453	0.4266	0.9453	0.9723
No log	8.0351	458	0.9494	0.4266	0.9494	0.9744
No log	8.0702	460	0.9766	0.4386	0.9766	0.9882
No log	8.1053	462	1.0752	0.4181	1.0752	1.0369
No log	8.1404	464	1.0904	0.4058	1.0904	1.0442
No log	8.1754	466	1.1095	0.4255	1.1095	1.0533
No log	8.2105	468	1.0231	0.3380	1.0231	1.0115
No log	8.2456	470	0.9578	0.2600	0.9578	0.9787
No log	8.2807	472	0.9635	0.2721	0.9635	0.9816
No log	8.3158	474	0.9721	0.2814	0.9721	0.9860
No log	8.3509	476	0.9554	0.2699	0.9554	0.9774
No log	8.3860	478	0.9405	0.2699	0.9405	0.9698
No log	8.4211	480	0.9909	0.3300	0.9909	0.9954
No log	8.4561	482	1.1080	0.3929	1.1080	1.0526
No log	8.4912	484	1.1547	0.3812	1.1547	1.0746
No log	8.5263	486	1.0722	0.4004	1.0722	1.0355
No log	8.5614	488	0.9616	0.2699	0.9616	0.9806
No log	8.5965	490	0.9236	0.3293	0.9236	0.9611
No log	8.6316	492	0.9274	0.3008	0.9274	0.9630
No log	8.6667	494	0.9334	0.3008	0.9334	0.9661
No log	8.7018	496	0.9272	0.3306	0.9272	0.9629
No log	8.7368	498	0.9401	0.3306	0.9401	0.9696
0.2835	8.7719	500	0.9238	0.3008	0.9238	0.9611
0.2835	8.8070	502	0.9190	0.2887	0.9190	0.9586
0.2835	8.8421	504	0.9982	0.3027	0.9982	0.9991
0.2835	8.8772	506	1.1403	0.3695	1.1403	1.0678
0.2835	8.9123	508	1.2523	0.3578	1.2523	1.1191
0.2835	8.9474	510	1.2329	0.3075	1.2329	1.1104
0.2835	8.9825	512	1.1329	0.3342	1.1329	1.0644
0.2835	9.0175	514	1.0054	0.2251	1.0054	1.0027
0.2835	9.0526	516	0.9604	0.2276	0.9604	0.9800
0.2835	9.0877	518	0.9508	0.2179	0.9508	0.9751
0.2835	9.1228	520	0.9683	0.2154	0.9683	0.9840
0.2835	9.1579	522	1.0574	0.3472	1.0574	1.0283
0.2835	9.1930	524	1.2338	0.3658	1.2338	1.1108
0.2835	9.2281	526	1.3819	0.3429	1.3819	1.1755
0.2835	9.2632	528	1.3750	0.3437	1.3750	1.1726
0.2835	9.2982	530	1.2486	0.3415	1.2486	1.1174
0.2835	9.3333	532	1.1101	0.3063	1.1101	1.0536
0.2835	9.3684	534	0.9907	0.2251	0.9907	0.9953
0.2835	9.4035	536	0.9074	0.2301	0.9074	0.9526
0.2835	9.4386	538	0.8822	0.3425	0.8822	0.9393
0.2835	9.4737	540	0.8854	0.3280	0.8854	0.9410
0.2835	9.5088	542	0.9467	0.3027	0.9467	0.9730
0.2835	9.5439	544	1.1243	0.3427	1.1243	1.0603
0.2835	9.5789	546	1.2608	0.3928	1.2608	1.1229
0.2835	9.6140	548	1.2645	0.3816	1.2645	1.1245
0.2835	9.6491	550	1.1829	0.3453	1.1829	1.0876
0.2835	9.6842	552	1.0743	0.3735	1.0743	1.0365
0.2835	9.7193	554	1.0642	0.3735	1.0642	1.0316
0.2835	9.7544	556	1.0761	0.3735	1.0761	1.0374
0.2835	9.7895	558	1.0347	0.3773	1.0347	1.0172
0.2835	9.8246	560	1.0615	0.3735	1.0615	1.0303
0.2835	9.8596	562	1.1516	0.4094	1.1516	1.0731
0.2835	9.8947	564	1.2495	0.3316	1.2495	1.1178
0.2835	9.9298	566	1.2290	0.3488	1.2290	1.1086
0.2835	9.9649	568	1.1239	0.4054	1.1239	1.0602
0.2835	10.0	570	1.0194	0.2963	1.0194	1.0097
0.2835	10.0351	572	0.9829	0.3027	0.9829	0.9914
0.2835	10.0702	574	1.0197	0.3570	1.0197	1.0098
0.2835	10.1053	576	1.0978	0.4439	1.0978	1.0478
0.2835	10.1404	578	1.1573	0.4318	1.1573	1.0758
0.2835	10.1754	580	1.2283	0.3937	1.2283	1.1083
0.2835	10.2105	582	1.2184	0.3156	1.2184	1.1038
0.2835	10.2456	584	1.1753	0.2505	1.1753	1.0841
0.2835	10.2807	586	1.1331	0.2408	1.1331	1.0645
0.2835	10.3158	588	1.0940	0.2647	1.0940	1.0459
0.2835	10.3509	590	1.0923	0.2647	1.0923	1.0451
0.2835	10.3860	592	1.1465	0.3124	1.1465	1.0707
0.2835	10.4211	594	1.2603	0.1654	1.2603	1.1226
0.2835	10.4561	596	1.3857	0.2926	1.3857	1.1771
0.2835	10.4912	598	1.4284	0.2588	1.4284	1.1952
0.2835	10.5263	600	1.4354	0.2457	1.4354	1.1981
0.2835	10.5614	602	1.3397	0.2144	1.3397	1.1575

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1