ASAP_FineTuningBERT_AugV7_k7_task1_organization_fold3

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9053
• Qwk: 0.3645
• Mse: 0.9060
• Rmse: 0.9518

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 64
• eval_batch_size: 64
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.3333	2	10.5217	0.0115	10.5207	3.2436
No log	0.6667	4	7.6880	0.0	7.6875	2.7726
No log	1.0	6	5.6604	0.0427	5.6599	2.3791
No log	1.3333	8	4.1254	0.0137	4.1252	2.0311
5.5182	1.6667	10	2.8760	0.0103	2.8760	1.6959
5.5182	2.0	12	2.1068	0.0983	2.1070	1.4516
5.5182	2.3333	14	1.6506	0.0417	1.6510	1.2849
5.5182	2.6667	16	1.5554	0.0417	1.5559	1.2474
5.5182	3.0	18	1.0476	0.0202	1.0483	1.0238
1.9025	3.3333	20	1.0486	0.0210	1.0493	1.0244
1.9025	3.6667	22	1.2120	0.0202	1.2127	1.1012
1.9025	4.0	24	1.6154	0.0365	1.6160	1.2712
1.9025	4.3333	26	1.8200	0.0478	1.8206	1.3493
1.9025	4.6667	28	1.4630	0.0302	1.4636	1.2098
1.6825	5.0	30	1.0442	0.0202	1.0450	1.0222
1.6825	5.3333	32	1.2114	0.0374	1.2121	1.1009
1.6825	5.6667	34	1.8763	0.0954	1.8769	1.3700
1.6825	6.0	36	1.5204	0.0900	1.5210	1.2333
1.6825	6.3333	38	1.0133	0.1217	1.0138	1.0069
1.6744	6.6667	40	1.3296	0.1103	1.3301	1.1533
1.6744	7.0	42	2.0684	0.0975	2.0692	1.4385
1.6744	7.3333	44	1.1002	0.1780	1.1008	1.0492
1.6744	7.6667	46	0.9021	0.2738	0.9027	0.9501
1.6744	8.0	48	1.2757	0.1508	1.2764	1.1298
1.1449	8.3333	50	0.9067	0.2657	0.9073	0.9525
1.1449	8.6667	52	0.7657	0.3315	0.7661	0.8753
1.1449	9.0	54	1.6813	0.1309	1.6821	1.2970
1.1449	9.3333	56	1.5772	0.1582	1.5779	1.2562
1.1449	9.6667	58	0.7438	0.4045	0.7441	0.8626
0.7941	10.0	60	0.8465	0.3851	0.8469	0.9203
0.7941	10.3333	62	0.9534	0.3746	0.9538	0.9767
0.7941	10.6667	64	0.9786	0.3806	0.9789	0.9894
0.7941	11.0	66	0.9610	0.4019	0.9613	0.9804
0.7941	11.3333	68	0.8984	0.3934	0.8987	0.9480
0.418	11.6667	70	1.4060	0.2728	1.4065	1.1859
0.418	12.0	72	1.0409	0.3515	1.0414	1.0205
0.418	12.3333	74	0.7570	0.4524	0.7572	0.8702
0.418	12.6667	76	1.2936	0.2996	1.2943	1.1377
0.418	13.0	78	1.4437	0.2887	1.4444	1.2018
0.3215	13.3333	80	0.8506	0.4234	0.8511	0.9226
0.3215	13.6667	82	1.1283	0.3099	1.1289	1.0625
0.3215	14.0	84	0.9025	0.4045	0.9031	0.9503
0.3215	14.3333	86	0.9363	0.3771	0.9367	0.9678
0.3215	14.6667	88	0.8705	0.4156	0.8709	0.9332
0.1866	15.0	90	0.9884	0.3832	0.9888	0.9944
0.1866	15.3333	92	1.1084	0.3406	1.1088	1.0530
0.1866	15.6667	94	0.7951	0.4410	0.7955	0.8919
0.1866	16.0	96	0.8671	0.4211	0.8675	0.9314
0.1866	16.3333	98	0.8807	0.4254	0.8812	0.9387
0.1669	16.6667	100	0.8364	0.4564	0.8369	0.9148
0.1669	17.0	102	1.0761	0.3304	1.0767	1.0377
0.1669	17.3333	104	0.8205	0.4324	0.8210	0.9061
0.1669	17.6667	106	0.9238	0.4107	0.9244	0.9614
0.1669	18.0	108	1.1396	0.3317	1.1402	1.0678
0.1532	18.3333	110	0.9276	0.3807	0.9281	0.9634
0.1532	18.6667	112	1.0744	0.3228	1.0749	1.0368
0.1532	19.0	114	0.9105	0.3958	0.9110	0.9544
0.1532	19.3333	116	1.0217	0.3568	1.0222	1.0110
0.1532	19.6667	118	1.3223	0.2941	1.3228	1.1501
0.1267	20.0	120	0.9095	0.4080	0.9100	0.9539
0.1267	20.3333	122	1.2342	0.3209	1.2347	1.1112
0.1267	20.6667	124	1.0153	0.3675	1.0159	1.0079
0.1267	21.0	126	1.0380	0.3601	1.0386	1.0191
0.1267	21.3333	128	0.9969	0.3830	0.9975	0.9988
0.1017	21.6667	130	0.8286	0.4188	0.8291	0.9106
0.1017	22.0	132	1.0356	0.3400	1.0362	1.0179
0.1017	22.3333	134	0.9241	0.3711	0.9247	0.9616
0.1017	22.6667	136	0.7934	0.4452	0.7939	0.8910
0.1017	23.0	138	1.2934	0.2678	1.2941	1.1376
0.1484	23.3333	140	1.2776	0.2878	1.2782	1.1306
0.1484	23.6667	142	0.8941	0.4126	0.8947	0.9459
0.1484	24.0	144	1.0806	0.3404	1.0813	1.0398
0.1484	24.3333	146	1.0911	0.3428	1.0917	1.0448
0.1484	24.6667	148	0.9452	0.3785	0.9458	0.9725
0.1115	25.0	150	1.1226	0.3358	1.1232	1.0598
0.1115	25.3333	152	0.8089	0.4327	0.8094	0.8997
0.1115	25.6667	154	0.8321	0.4274	0.8326	0.9125
0.1115	26.0	156	1.1548	0.3109	1.1554	1.0749
0.1115	26.3333	158	0.8540	0.4195	0.8545	0.9244
0.1238	26.6667	160	0.9073	0.3952	0.9078	0.9528
0.1238	27.0	162	0.9665	0.3730	0.9670	0.9834
0.1238	27.3333	164	1.1367	0.3278	1.1373	1.0664
0.1238	27.6667	166	0.9352	0.3804	0.9357	0.9673
0.1238	28.0	168	1.1351	0.3280	1.1356	1.0657
0.0849	28.3333	170	0.8962	0.3609	0.8967	0.9469
0.0849	28.6667	172	1.0467	0.3434	1.0472	1.0233
0.0849	29.0	174	0.9232	0.3546	0.9236	0.9610
0.0849	29.3333	176	1.0912	0.3075	1.0916	1.0448
0.0849	29.6667	178	0.9683	0.3729	0.9687	0.9842
0.0863	30.0	180	0.9918	0.3577	0.9923	0.9961
0.0863	30.3333	182	0.9164	0.3680	0.9168	0.9575
0.0863	30.6667	184	1.0930	0.3239	1.0935	1.0457
0.0863	31.0	186	0.9428	0.3749	0.9433	0.9713
0.0863	31.3333	188	0.7951	0.4396	0.7955	0.8919
0.0893	31.6667	190	1.0387	0.3491	1.0393	1.0195
0.0893	32.0	192	1.0738	0.3188	1.0743	1.0365
0.0893	32.3333	194	0.8394	0.4359	0.8400	0.9165
0.0893	32.6667	196	1.0806	0.3163	1.0812	1.0398
0.0893	33.0	198	1.0722	0.3137	1.0728	1.0357
0.0865	33.3333	200	0.9139	0.4021	0.9145	0.9563
0.0865	33.6667	202	1.0580	0.3371	1.0585	1.0288
0.0865	34.0	204	0.8219	0.4281	0.8225	0.9069
0.0865	34.3333	206	0.8475	0.3969	0.8480	0.9208
0.0865	34.6667	208	1.1374	0.3178	1.1380	1.0668
0.0822	35.0	210	0.9123	0.4104	0.9128	0.9554
0.0822	35.3333	212	0.9450	0.3847	0.9456	0.9724
0.0822	35.6667	214	1.0836	0.3440	1.0841	1.0412
0.0822	36.0	216	0.8492	0.4239	0.8497	0.9218
0.0822	36.3333	218	0.9928	0.3724	0.9933	0.9967
0.0712	36.6667	220	1.0071	0.3653	1.0077	1.0038
0.0712	37.0	222	0.7982	0.4406	0.7988	0.8938
0.0712	37.3333	224	0.8736	0.4086	0.8742	0.9350
0.0712	37.6667	226	1.2383	0.2986	1.2390	1.1131
0.0712	38.0	228	0.9966	0.3458	0.9972	0.9986
0.0909	38.3333	230	0.8603	0.3894	0.8609	0.9278
0.0909	38.6667	232	1.0707	0.3594	1.0713	1.0350
0.0909	39.0	234	0.9448	0.3863	0.9454	0.9723
0.0909	39.3333	236	0.7854	0.4463	0.7860	0.8866
0.0909	39.6667	238	0.9675	0.3766	0.9682	0.9840
0.076	40.0	240	0.9733	0.3832	0.9740	0.9869
0.076	40.3333	242	0.8940	0.4112	0.8947	0.9459
0.076	40.6667	244	0.9786	0.3787	0.9792	0.9896
0.076	41.0	246	0.7892	0.4287	0.7898	0.8887
0.076	41.3333	248	0.8250	0.4272	0.8256	0.9086
0.067	41.6667	250	1.0166	0.3708	1.0173	1.0086
0.067	42.0	252	0.8517	0.4313	0.8524	0.9232
0.067	42.3333	254	0.8821	0.4120	0.8827	0.9395
0.067	42.6667	256	1.0361	0.3509	1.0367	1.0182
0.067	43.0	258	0.8743	0.4085	0.8749	0.9354
0.0681	43.3333	260	0.9633	0.3658	0.9639	0.9818
0.0681	43.6667	262	1.0557	0.3480	1.0563	1.0278
0.0681	44.0	264	0.9226	0.3754	0.9233	0.9609
0.0681	44.3333	266	1.0096	0.3700	1.0103	1.0051
0.0681	44.6667	268	1.0064	0.3625	1.0071	1.0035
0.0642	45.0	270	1.0891	0.3274	1.0897	1.0439
0.0642	45.3333	272	0.9279	0.3773	0.9285	0.9636
0.0642	45.6667	274	1.1640	0.3443	1.1646	1.0792
0.0642	46.0	276	1.1355	0.3451	1.1361	1.0659
0.0642	46.3333	278	0.9374	0.3808	0.9380	0.9685
0.0614	46.6667	280	1.1060	0.3502	1.1067	1.0520
0.0614	47.0	282	1.0050	0.3670	1.0056	1.0028
0.0614	47.3333	284	1.1122	0.3587	1.1128	1.0549
0.0614	47.6667	286	0.9819	0.3594	0.9825	0.9912
0.0614	48.0	288	0.9747	0.3536	0.9754	0.9876
0.0587	48.3333	290	1.0293	0.3489	1.0299	1.0149
0.0587	48.6667	292	0.9455	0.3643	0.9461	0.9727
0.0587	49.0	294	0.8974	0.3778	0.8981	0.9477
0.0587	49.3333	296	0.9597	0.3591	0.9604	0.9800
0.0587	49.6667	298	0.8689	0.3797	0.8696	0.9325
0.0528	50.0	300	0.8567	0.3893	0.8574	0.9260
0.0528	50.3333	302	0.8063	0.4335	0.8069	0.8983
0.0528	50.6667	304	1.0297	0.3516	1.0304	1.0151
0.0528	51.0	306	1.0772	0.3292	1.0779	1.0382
0.0528	51.3333	308	0.8444	0.3861	0.8451	0.9193
0.0701	51.6667	310	0.8594	0.3633	0.8601	0.9274
0.0701	52.0	312	1.2076	0.3128	1.2083	1.0992
0.0701	52.3333	314	1.2746	0.3035	1.2753	1.1293
0.0701	52.6667	316	0.9092	0.3597	0.9099	0.9539
0.0701	53.0	318	0.8477	0.4305	0.8484	0.9211
0.0707	53.3333	320	1.0953	0.3367	1.0960	1.0469
0.0707	53.6667	322	1.1426	0.3279	1.1432	1.0692
0.0707	54.0	324	0.9062	0.3842	0.9069	0.9523
0.0707	54.3333	326	0.9535	0.3609	0.9542	0.9768
0.0707	54.6667	328	0.9894	0.3491	0.9901	0.9950
0.056	55.0	330	0.8239	0.4199	0.8245	0.9080
0.056	55.3333	332	0.8388	0.4026	0.8395	0.9162
0.056	55.6667	334	1.1227	0.3380	1.1234	1.0599
0.056	56.0	336	1.1632	0.3323	1.1638	1.0788
0.056	56.3333	338	0.8587	0.4026	0.8594	0.9270
0.063	56.6667	340	0.8121	0.4274	0.8127	0.9015
0.063	57.0	342	1.0164	0.3592	1.0171	1.0085
0.063	57.3333	344	1.0625	0.3623	1.0631	1.0311
0.063	57.6667	346	0.8661	0.4063	0.8667	0.9310
0.063	58.0	348	0.8953	0.3785	0.8959	0.9465
0.053	58.3333	350	1.0334	0.3581	1.0340	1.0169
0.053	58.6667	352	0.8830	0.4071	0.8836	0.9400
0.053	59.0	354	0.9080	0.3979	0.9087	0.9532
0.053	59.3333	356	1.0564	0.3579	1.0570	1.0281
0.053	59.6667	358	0.9177	0.3800	0.9183	0.9583
0.0527	60.0	360	0.9047	0.3962	0.9054	0.9515
0.0527	60.3333	362	0.9210	0.3904	0.9216	0.9600
0.0527	60.6667	364	1.0597	0.3569	1.0603	1.0297
0.0527	61.0	366	0.9971	0.3579	0.9978	0.9989
0.0527	61.3333	368	0.8296	0.4351	0.8302	0.9111
0.0451	61.6667	370	0.8309	0.4237	0.8314	0.9118
0.0451	62.0	372	0.9598	0.3778	0.9604	0.9800
0.0451	62.3333	374	0.8734	0.3875	0.8740	0.9349
0.0451	62.6667	376	0.8478	0.3933	0.8484	0.9211
0.0451	63.0	378	0.9200	0.3654	0.9207	0.9595
0.0547	63.3333	380	0.8869	0.3782	0.8875	0.9421
0.0547	63.6667	382	0.7898	0.4180	0.7904	0.8891
0.0547	64.0	384	0.8544	0.4002	0.8551	0.9247
0.0547	64.3333	386	0.8858	0.3885	0.8864	0.9415
0.0547	64.6667	388	0.8683	0.4017	0.8689	0.9322
0.0487	65.0	390	0.8071	0.4267	0.8077	0.8987
0.0487	65.3333	392	0.8163	0.4315	0.8170	0.9039
0.0487	65.6667	394	0.9288	0.3733	0.9294	0.9641
0.0487	66.0	396	0.9050	0.3971	0.9056	0.9516
0.0487	66.3333	398	0.7972	0.4629	0.7978	0.8932
0.0429	66.6667	400	0.8218	0.4636	0.8224	0.9069
0.0429	67.0	402	0.9654	0.3620	0.9660	0.9828
0.0429	67.3333	404	0.9517	0.3741	0.9523	0.9758
0.0429	67.6667	406	0.9235	0.3835	0.9241	0.9613
0.0429	68.0	408	1.0092	0.3612	1.0098	1.0049
0.0413	68.3333	410	0.9035	0.3940	0.9041	0.9508
0.0413	68.6667	412	0.8016	0.4604	0.8021	0.8956
0.0413	69.0	414	0.8618	0.4267	0.8624	0.9287
0.0413	69.3333	416	0.9808	0.3628	0.9814	0.9907
0.0413	69.6667	418	0.9295	0.3827	0.9301	0.9644
0.0441	70.0	420	0.9146	0.3829	0.9153	0.9567
0.0441	70.3333	422	0.9298	0.3499	0.9304	0.9646
0.0441	70.6667	424	0.9430	0.3490	0.9436	0.9714
0.0441	71.0	426	0.8707	0.3975	0.8713	0.9334
0.0441	71.3333	428	0.9480	0.3550	0.9487	0.9740
0.0424	71.6667	430	1.0020	0.3612	1.0026	1.0013
0.0424	72.0	432	0.8777	0.3887	0.8783	0.9372
0.0424	72.3333	434	0.7783	0.4255	0.7789	0.8825
0.0424	72.6667	436	0.7914	0.4419	0.7920	0.8900
0.0424	73.0	438	0.9218	0.3654	0.9225	0.9605
0.0503	73.3333	440	0.9841	0.3546	0.9848	0.9924
0.0503	73.6667	442	0.8737	0.3957	0.8744	0.9351
0.0503	74.0	444	0.7834	0.4314	0.7840	0.8854
0.0503	74.3333	446	0.7878	0.4430	0.7884	0.8879
0.0503	74.6667	448	0.8897	0.4014	0.8904	0.9436
0.0438	75.0	450	1.0488	0.3610	1.0495	1.0245
0.0438	75.3333	452	1.0143	0.3727	1.0150	1.0075
0.0438	75.6667	454	0.8513	0.4250	0.8519	0.9230
0.0438	76.0	456	0.8057	0.4658	0.8063	0.8980
0.0438	76.3333	458	0.8664	0.4229	0.8670	0.9311
0.0459	76.6667	460	0.9978	0.3703	0.9984	0.9992
0.0459	77.0	462	0.9692	0.3712	0.9699	0.9848
0.0459	77.3333	464	0.8752	0.4446	0.8758	0.9358
0.0459	77.6667	466	0.8884	0.4031	0.8890	0.9429
0.0459	78.0	468	0.9747	0.3728	0.9753	0.9876
0.036	78.3333	470	0.9663	0.3752	0.9669	0.9833
0.036	78.6667	472	0.8849	0.3953	0.8855	0.9410
0.036	79.0	474	0.9057	0.3824	0.9064	0.9520
0.036	79.3333	476	0.9547	0.3642	0.9554	0.9774
0.036	79.6667	478	0.9112	0.3822	0.9119	0.9549
0.0346	80.0	480	0.8784	0.4230	0.8791	0.9376
0.0346	80.3333	482	0.8821	0.4161	0.8827	0.9395
0.0346	80.6667	484	0.8865	0.4149	0.8871	0.9419
0.0346	81.0	486	0.8332	0.4360	0.8339	0.9132
0.0346	81.3333	488	0.8489	0.4258	0.8496	0.9217
0.0411	81.6667	490	0.9248	0.3792	0.9255	0.9620
0.0411	82.0	492	0.9166	0.3793	0.9172	0.9577
0.0411	82.3333	494	0.8562	0.4080	0.8568	0.9257
0.0411	82.6667	496	0.8607	0.4115	0.8614	0.9281
0.0411	83.0	498	0.8814	0.4065	0.8821	0.9392
0.0364	83.3333	500	0.9304	0.3837	0.9311	0.9649
0.0364	83.6667	502	0.9168	0.3806	0.9175	0.9578
0.0364	84.0	504	0.8633	0.4130	0.8639	0.9295
0.0364	84.3333	506	0.8749	0.4032	0.8755	0.9357
0.0364	84.6667	508	0.9048	0.3866	0.9054	0.9515
0.0362	85.0	510	0.8597	0.4099	0.8603	0.9275
0.0362	85.3333	512	0.8525	0.4105	0.8532	0.9237
0.0362	85.6667	514	0.8367	0.4244	0.8373	0.9150
0.0362	86.0	516	0.8816	0.3808	0.8822	0.9393
0.0362	86.3333	518	0.9260	0.3579	0.9267	0.9626
0.0378	86.6667	520	0.9151	0.3643	0.9158	0.9570
0.0378	87.0	522	0.8541	0.4350	0.8548	0.9245
0.0378	87.3333	524	0.8419	0.4421	0.8425	0.9179
0.0378	87.6667	526	0.8805	0.4165	0.8812	0.9387
0.0378	88.0	528	0.9119	0.3787	0.9125	0.9553
0.0374	88.3333	530	0.9134	0.3743	0.9140	0.9560
0.0374	88.6667	532	0.9445	0.3666	0.9451	0.9722
0.0374	89.0	534	0.9447	0.3634	0.9453	0.9723
0.0374	89.3333	536	0.9053	0.3645	0.9060	0.9518

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.1+cu121
• Datasets 3.2.0
• Tokenizers 0.19.1