ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k6_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6684
• Qwk: 0.2986
• Mse: 0.6684
• Rmse: 0.8175

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0769	2	3.4256	0.0013	3.4256	1.8508
No log	0.1538	4	1.8432	-0.0370	1.8432	1.3576
No log	0.2308	6	1.0843	0.0588	1.0843	1.0413
No log	0.3077	8	1.0200	0.0	1.0200	1.0099
No log	0.3846	10	0.9014	0.1228	0.9014	0.9494
No log	0.4615	12	1.0009	0.1020	1.0009	1.0005
No log	0.5385	14	0.8330	0.2222	0.8330	0.9127
No log	0.6154	16	0.5826	0.0569	0.5826	0.7633
No log	0.6923	18	0.5896	0.0	0.5896	0.7678
No log	0.7692	20	0.6292	0.0638	0.6292	0.7932
No log	0.8462	22	0.7030	0.1638	0.7030	0.8385
No log	0.9231	24	0.6307	0.0222	0.6307	0.7942
No log	1.0	26	0.5897	0.0	0.5897	0.7679
No log	1.0769	28	0.5870	0.0	0.5870	0.7662
No log	1.1538	30	0.6023	-0.0159	0.6023	0.7761
No log	1.2308	32	0.6287	-0.1111	0.6287	0.7929
No log	1.3077	34	0.6495	0.0769	0.6495	0.8059
No log	1.3846	36	0.6012	-0.1594	0.6012	0.7754
No log	1.4615	38	0.6177	-0.1111	0.6177	0.7859
No log	1.5385	40	0.6544	0.0952	0.6544	0.8090
No log	1.6154	42	0.6670	0.2432	0.6670	0.8167
No log	1.6923	44	1.0470	0.0286	1.0470	1.0232
No log	1.7692	46	1.0535	-0.1200	1.0535	1.0264
No log	1.8462	48	0.8844	0.0545	0.8844	0.9404
No log	1.9231	50	0.6499	0.0	0.6499	0.8061
No log	2.0	52	0.8516	0.2208	0.8516	0.9228
No log	2.0769	54	1.4700	0.0335	1.4700	1.2124
No log	2.1538	56	1.5063	0.0335	1.5063	1.2273
No log	2.2308	58	0.9647	0.1111	0.9647	0.9822
No log	2.3077	60	0.5928	-0.0612	0.5928	0.7700
No log	2.3846	62	0.6166	0.0	0.6166	0.7852
No log	2.4615	64	0.6258	0.0	0.6258	0.7911
No log	2.5385	66	0.5942	0.0	0.5942	0.7709
No log	2.6154	68	0.5795	0.0933	0.5795	0.7613
No log	2.6923	70	0.8434	0.2000	0.8434	0.9184
No log	2.7692	72	1.0746	0.0388	1.0746	1.0366
No log	2.8462	74	0.9208	0.1545	0.9208	0.9596
No log	2.9231	76	0.5930	0.1345	0.5930	0.7700
No log	3.0	78	0.6299	0.1407	0.6299	0.7936
No log	3.0769	80	0.8479	0.1515	0.8479	0.9208
No log	3.1538	82	0.8592	0.2000	0.8592	0.9269
No log	3.2308	84	0.6557	0.2000	0.6557	0.8097
No log	3.3077	86	0.5283	0.0303	0.5283	0.7268
No log	3.3846	88	0.8102	0.1667	0.8102	0.9001
No log	3.4615	90	1.1025	0.0388	1.1025	1.0500
No log	3.5385	92	1.2326	0.0286	1.2326	1.1102
No log	3.6154	94	0.8842	0.1588	0.8842	0.9403
No log	3.6923	96	0.5409	0.1781	0.5409	0.7355
No log	3.7692	98	0.8106	0.2000	0.8106	0.9004
No log	3.8462	100	0.9384	0.2000	0.9384	0.9687
No log	3.9231	102	0.8056	0.2000	0.8056	0.8976
No log	4.0	104	0.5911	0.3136	0.5911	0.7688
No log	4.0769	106	0.9953	0.1486	0.9953	0.9976
No log	4.1538	108	1.4667	0.1795	1.4667	1.2111
No log	4.2308	110	1.2653	0.1634	1.2653	1.1248
No log	4.3077	112	0.7565	0.0968	0.7565	0.8698
No log	4.3846	114	0.6077	0.3757	0.6077	0.7795
No log	4.4615	116	0.7328	0.1770	0.7328	0.8560
No log	4.5385	118	0.7100	0.2081	0.7100	0.8426
No log	4.6154	120	0.6077	0.3182	0.6077	0.7795
No log	4.6923	122	0.6431	0.2174	0.6431	0.8019
No log	4.7692	124	1.0368	0.1264	1.0368	1.0182
No log	4.8462	126	1.2556	0.1601	1.2556	1.1205
No log	4.9231	128	1.0768	0.1161	1.0768	1.0377
No log	5.0	130	0.7498	0.1527	0.7498	0.8659
No log	5.0769	132	0.6144	0.2663	0.6144	0.7838
No log	5.1538	134	0.7003	0.36	0.7003	0.8369
No log	5.2308	136	0.7162	0.3171	0.7162	0.8463
No log	5.3077	138	0.6406	0.2432	0.6406	0.8004
No log	5.3846	140	0.6264	0.2914	0.6264	0.7914
No log	5.4615	142	0.8126	0.2066	0.8126	0.9014
No log	5.5385	144	0.9458	0.2243	0.9458	0.9725
No log	5.6154	146	0.8313	0.1405	0.8313	0.9118
No log	5.6923	148	0.6576	0.2350	0.6576	0.8109
No log	5.7692	150	0.6349	0.2626	0.6349	0.7968
No log	5.8462	152	0.6673	0.2670	0.6673	0.8169
No log	5.9231	154	0.6792	0.2577	0.6792	0.8241
No log	6.0	156	0.6958	0.3061	0.6958	0.8341
No log	6.0769	158	0.7904	0.3750	0.7904	0.8891
No log	6.1538	160	0.7995	0.3834	0.7995	0.8941
No log	6.2308	162	0.7418	0.3648	0.7418	0.8613
No log	6.3077	164	0.7328	0.2212	0.7328	0.8561
No log	6.3846	166	0.7302	0.2857	0.7302	0.8545
No log	6.4615	168	0.7329	0.3162	0.7329	0.8561
No log	6.5385	170	0.7434	0.2605	0.7434	0.8622
No log	6.6154	172	0.7676	0.2489	0.7676	0.8761
No log	6.6923	174	0.7386	0.2489	0.7386	0.8594
No log	6.7692	176	0.6765	0.3171	0.6765	0.8225
No log	6.8462	178	0.6624	0.3333	0.6624	0.8139
No log	6.9231	180	0.6735	0.4231	0.6735	0.8207
No log	7.0	182	0.6749	0.3951	0.6749	0.8215
No log	7.0769	184	0.6708	0.3769	0.6708	0.8190
No log	7.1538	186	0.6728	0.2919	0.6728	0.8202
No log	7.2308	188	0.7239	0.2143	0.7239	0.8508
No log	7.3077	190	0.7961	0.2566	0.7961	0.8922
No log	7.3846	192	0.7837	0.2489	0.7837	0.8853
No log	7.4615	194	0.7306	0.2372	0.7306	0.8547
No log	7.5385	196	0.7479	0.3496	0.7479	0.8648
No log	7.6154	198	0.8970	0.3074	0.8970	0.9471
No log	7.6923	200	0.9890	0.2054	0.9890	0.9945
No log	7.7692	202	0.9447	0.2281	0.9447	0.9719
No log	7.8462	204	0.8099	0.3619	0.8099	0.8999
No log	7.9231	206	0.7150	0.1928	0.7150	0.8456
No log	8.0	208	0.7348	0.3043	0.7348	0.8572
No log	8.0769	210	0.7691	0.2566	0.7691	0.8770
No log	8.1538	212	0.7562	0.2566	0.7562	0.8696
No log	8.2308	214	0.7026	0.2919	0.7026	0.8382
No log	8.3077	216	0.6670	0.2621	0.6670	0.8167
No log	8.3846	218	0.6700	0.3143	0.6700	0.8186
No log	8.4615	220	0.6947	0.2713	0.6947	0.8335
No log	8.5385	222	0.7165	0.3000	0.7165	0.8464
No log	8.6154	224	0.7354	0.3000	0.7354	0.8575
No log	8.6923	226	0.7377	0.3171	0.7377	0.8589
No log	8.7692	228	0.7232	0.3000	0.7232	0.8504
No log	8.8462	230	0.7082	0.3080	0.7082	0.8415
No log	8.9231	232	0.6900	0.2542	0.6900	0.8307
No log	9.0	234	0.6767	0.2857	0.6767	0.8226
No log	9.0769	236	0.6741	0.2579	0.6741	0.8211
No log	9.1538	238	0.6725	0.2579	0.6725	0.8201
No log	9.2308	240	0.6693	0.2372	0.6693	0.8181
No log	9.3077	242	0.6703	0.2000	0.6703	0.8187
No log	9.3846	244	0.6703	0.2621	0.6703	0.8187
No log	9.4615	246	0.6690	0.2986	0.6690	0.8179
No log	9.5385	248	0.6692	0.2986	0.6692	0.8180
No log	9.6154	250	0.6704	0.2986	0.6704	0.8188
No log	9.6923	252	0.6702	0.2986	0.6702	0.8187
No log	9.7692	254	0.6695	0.2986	0.6695	0.8183
No log	9.8462	256	0.6686	0.2986	0.6686	0.8177
No log	9.9231	258	0.6685	0.2986	0.6685	0.8176
No log	10.0	260	0.6684	0.2986	0.6684	0.8175

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1